00000001:02000400:2.0F:1789265054.547678:0:2972:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg337-server.virtnet: executing set_hostid 00000001:02000400:1.0F:1789265070.493492:0:3192:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg337-server.virtnet: executing load_modules_local 00000001:01000000:2.0:1789265072.247658:0:3233:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 545 MB/s 00000001:01000000:2.0:1789265072.499893:0:3233:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 551 MB/s 00000001:01000000:3.0F:1789265072.751630:0:3233:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 5734 MB/s 00000020:02000000:2.0:1789265073.500056:0:3283:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_105_g2595dd0 00000400:02000000:2.0:1789265074.623582:0:3299:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.203.137@tcp [8/256/0/180] 00008000:02000000:0.0F:1789265077.917592:0:3448:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1789265122.968464:0:5251:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg337-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1789265131.720973:0:5821:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789265131.720978:0:5821:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1789265131.721323:0:5821:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000012cce23f 00000080:02000400:0.0:1789265131.721334:0:5821:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1789265131.725506:0:5821:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1789265131.725518:0:5821:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1789265131.725705:0:5821:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000de73960f) 00000020:00000080:1.0:1789265131.725726:0:5821:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1789265131.748040:0:5821:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1789265131.748650:0:5821:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1789265131.771732:0:5821:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1789265131.771771:0:5821:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789265131.771793:0:5821:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1789265131.771845:0:5821:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789265131.771881:0:5821:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1789265131.772665:0:5821:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789265131.772673:0:5821:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789265131.772683:0:5821:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x27274ba5bb951b61 00000020:01000004:2.0:1789265131.772691:0:5821:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1789265131.772695:0:5821:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789265131.772700:0:5821:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000012cce23f from MGS 00000020:01000004:2.0:1789265131.772703:0:5821:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789265131.772720:0:5821:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000b0a5ac2a) 00000020:00000080:2.0:1789265131.772731:0:5821:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789265131.772828:0:5821:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000012cce23f from MGS, refs=2 00080000:01000000:2.0:1789265131.772833:0:5821:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789265131.772841:0:5821:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x27274ba5bb951b6f 00000100:00100000:2.0:1789265131.772943:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789265131.773563:0:5821:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789265131.773570:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1789265131.774020:0:5821:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1789265131.774027:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1789265131.776009:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789265131.778567:0:5821:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1789265131.778577:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1789265131.781316:0:5821:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1789265131.781337:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1789265131.781907:0:5821:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1789265131.781914:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1789265131.782688:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265131.782692:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265131.782694:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265131.782962:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265131.782964:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265131.782966:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265131.788001:0:5821:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1789265131.791873:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1789265132.037659:0:5821:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3267 MB/s 00000001:01000000:0.0:1789265132.287143:0:5821:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3127 MB/s 00000001:01000000:3.0:1789265132.537618:0:5821:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 500 MB/s 00000001:01000000:3.0:1789265132.787401:0:5821:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 959 MB/s 00080000:10000000:3.0:1789265132.798536:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:0.0:1789265132.835021:0:5821:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1789265132.835238:0:5821:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789265132.835242:0:5821:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1789265132.836274:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1789265132.836336:0:5821:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1789265132.836374:0:5821:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1789265132.836692:0:5821:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1789265132.840803:0:5821:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1789265132.846019:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789265132.846244:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1789265132.846251:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1789265132.848206:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1789265132.848218:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00010000:00010000:3.0:1789265132.850635:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265132.855617:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1789265132.855634:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1789265132.866534:0:5821:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1789265132.866559:0:5821:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.137@tcp' 00000020:01000004:3.0:1789265132.866561:0:5821:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1789265132.866607:0:5821:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.137@tcp (typ=mgc) 00000020:00000080:3.0:1789265132.866632:0:5821:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.137@tcp (00000000e2339357) 00000020:00000080:3.0:1789265132.866650:0:5821:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1789265132.866740:0:5821:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000004f716b3@MGC192.168.203.137@tcp: add connection 192.168.203.137@tcp at head 00010000:00010000:3.0:1789265132.866894:0:5821:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.137@tcp-0 is initialized 00000040:01000000:3.0:1789265132.866900:0:5821:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.137@tcp ctxt 1 is initialized 00000100:00080000:2.0:1789265132.867138:0:5836:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1789265132.870644:0:5837:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1789265132.872342:0:5821:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.137@tcp (uuid 871daf34-1206-40e7-bd71-78303abe4d37) 00000020:00000080:3.0:1789265132.872367:0:5821:0:(genops.c:1385:class_connect()) connect: client 871daf34-1206-40e7-bd71-78303abe4d37, cookie 0x27274ba5bb951b7d 00000100:00080000:3.0:1789265132.872380:0:5821:0:(import.c:510:import_select_connection()) MGC192.168.203.137@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789265132.872385:0:5821:0:(import.c:624:import_select_connection()) MGC192.168.203.137@tcp: import 0000000004f716b3 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:3.0:1789265132.872432:0:5821:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000006c53c63c x1876180414234752/t0(0) o250->MGC192.168.203.137@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789265132.872521:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006c53c63c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:871daf34-1206-40e7-bd71-78303abe4d37:3314:1876180414234752:0@lo:250: 00000100:00100000:3.0:1789265132.872619:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789265132.872679:0:5821:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 871daf34-1206-40e7-bd71-78303abe4d37->MGS 00000020:01000004:3.0:1789265132.872700:0:5821:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1789265132.872705:0:5821:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1789265132.872719:0:5821:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000039269955) 00000020:00000080:3.0:1789265132.872733:0:5821:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1789265132.884884:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414234752 00000100:00100000:2.0:1789265132.884897:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414234752 00000100:00100000:2.0:1789265132.884939:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789265132.884946:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000031772ac5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3314:x1876180414234752:12345-0@lo:250: 00010000:00080000:2.0:1789265132.884971:0:5833:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 871daf34-1206-40e7-bd71-78303abe4d37@0@lo t0 exp 0000000000000000 cur 178 last 0 00000020:00000080:2.0:1789265132.884999:0:5833:0:(genops.c:1385:class_connect()) connect: client 871daf34-1206-40e7-bd71-78303abe4d37, cookie 0x27274ba5bb951b8b 00000100:00080000:2.0:1789265132.885163:0:5833:0:(import.c:65:import_set_state_nolock()) 00000000a392a26a : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789265132.885274:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000031772ac5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+5:3314:x1876180414234752:12345-0@lo:250: Request processed in 326us (12655us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265132.885282:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789265132.889028:0:3314:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.137@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1789265132.889043:0:3314:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.137@tcp: connect to target with instance 0 00000100:00080000:1.0:1789265132.889051:0:3314:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.137@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1789265132.889056:0:3314:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1789265132.889059:0:3314:0:(import.c:65:import_set_state_nolock()) 0000000004f716b3 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1789265132.889062:0:3314:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1789265132.889102:0:3314:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1789265132.889109:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006c53c63c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:871daf34-1206-40e7-bd71-78303abe4d37:3314:1876180414234752:0@lo:250: 00000100:00100000:3.0:1789265132.895525:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789265132.896413:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1789265132.896418:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1789265132.897823:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1789265132.897835:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1789265132.898378:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1789265132.898384:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1789265132.899398:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789265132.900476:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1789265132.900491:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1789265132.902109:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1789265132.902121:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1789265132.947682:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789265132.948007:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1789265132.948014:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1789265132.951852:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1789265132.951874:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1789265132.952892:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789265132.953065:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789265132.953070:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1789265132.953964:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789265132.953973:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1789265132.954773:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789265132.954948:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789265132.954953:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1789265132.955971:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789265132.955981:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1789265132.958774:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789265132.958972:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789265132.958984:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1789265132.959925:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789265132.959932:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1789265133.002114:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789265133.002379:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789265133.002385:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1789265133.003695:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789265133.003706:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1789265133.005162:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789265133.005181:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1789265133.006392:0:5821:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1789265133.006416:0:5821:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1789265133.006422:0:5821:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.137@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1789265133.006537:0:5821:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.137@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789265133.006576:0:5821:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.137@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1789265133.006581:0:5821:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789265133.006582:0:5821:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789265133.006583:0:5821:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789265133.006584:0:5821:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789265133.006585:0:5821:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789265133.006587:0:5821:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789265133.006588:0:5821:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789265133.006590:0:5821:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789265133.006591:0:5821:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789265133.006592:0:5821:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789265133.006593:0:5821:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789265133.006594:0:5821:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789265133.006596:0:5821:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1789265133.006599:0:5821:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789265133.006600:0:5821:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789265133.006601:0:5821:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789265133.006602:0:5821:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789265133.006603:0:5821:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789265133.006604:0:5821:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789265133.006605:0:5821:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789265133.006606:0:5821:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789265133.006611:0:5821:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789265133.006611:0:5821:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789265133.006612:0:5821:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789265133.006613:0:5821:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789265133.006636:0:5821:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789265133.006652:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000655adf84 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:5821:1876180414234880:0@lo:253: 00000100:00100000:3.0:1789265133.006714:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265133.006766:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set 000000006ddc6764 going to sleep for 11 seconds 00000100:00100000:2.0:1789265133.006916:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414234880 00000100:00100000:2.0:1789265133.006923:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414234880 00000100:00100000:2.0:1789265133.006968:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789265133.006977:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004913a6a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+5:5821:x1876180414234880:12345-0@lo:253: 20000000:01000000:2.0:1789265133.007025:0:5835:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789265133.007029:0:5835:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1789265133.007384:0:5856:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1789265133.007439:0:5835:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1789265133.008515:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789265133.010895:0:5857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1789265133.011282:0:5835:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789265133.011287:0:5835:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1789265133.011292:0:5835:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1789265133.011295:0:5835:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1789265133.011312:0:5835:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1789265133.011521:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789265133.011740:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1789265133.011825:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789265133.011878:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1789265133.011931:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1789265133.011971:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1789265133.012063:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1789265133.012215:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1789265133.012284:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1789265133.012294:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1789265133.012326:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1789265133.012333:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1789265133.012361:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1789265133.012411:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1789265133.012445:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1789265133.012450:0:5835:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1789265133.012464:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789265133.012654:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1789265133.012664:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789265133.012697:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1789265133.012732:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1789265133.012861:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1789265133.012874:0:5835:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1789265133.012945:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1789265133.012953:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1789265133.012996:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1789265133.013033:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1789265133.013069:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1789265133.013227:0:5835:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1789265133.013329:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1789265133.013339:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1789265133.013369:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1789265133.013403:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1789265133.013552:0:5835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1789265133.013595:0:5835:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1789265133.013602:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1789265133.014280:0:5858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1789265133.014540:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1789265133.014560:0:5835:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.137@tcp for mdt 20000000:01000000:1.0:1789265133.014569:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.137@tcp (null) (null) (null) 00000040:00080000:1.0:1789265133.014606:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1789265133.014614:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1789265133.014643:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1789265133.014650:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.137@tcp (null) (null) 00000040:00080000:1.0:1789265133.014706:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1789265133.014717:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1789265133.014749:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1789265133.014784:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1789265133.014840:0:5835:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789265133.014843:0:5835:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789265133.014846:0:5835:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789265133.014857:0:5835:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789265133.014860:0:5835:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1789265133.014887:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789265133.014890:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789265133.015479:0:5859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1789265133.015702:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1789265133.015742:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1789265133.015772:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:1.0:1789265133.015783:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789265133.015785:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789265133.016718:0:5860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:1.0:1789265133.016975:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1789265133.017019:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:1.0:1789265133.017192:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:1.0:1789265133.017207:0:5835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789265133.017209:0:5835:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:1.0:1789265133.017214:0:5835:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1789265133.017216:0:5835:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1789265133.017221:0:5835:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1789265133.017226:0:5835:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1789265133.017638:0:5861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1789265133.017752:0:5835:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1789265133.034444:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:1.0:1789265133.034496:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:1.0:1789265133.034607:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:1.0:1789265133.034629:0:5835:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789265133.034648:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000035398f0/0x27274ba5bb951b92 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265133.034663:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000035398f0/0x27274ba5bb951b92 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265133.034672:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000035398f0/0x27274ba5bb951b92 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265133.034678:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000035398f0/0x27274ba5bb951b92 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265133.034683:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000035398f0/0x27274ba5bb951b92 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265133.037547:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000035398f0/0x27274ba5bb951b92 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265133.037556:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000035398f0 already unused, calling callback (000000009c5d5074) 00010000:00010000:1.0:1789265133.037560:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000035398f0/0x27274ba5bb951b92 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265133.037569:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000035398f0/0x27274ba5bb951b92 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265133.037582:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000035398f0/0x27274ba5bb951b92 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265133.037611:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000035398f0/0x27274ba5bb951b92 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265133.037616:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000035398f0/0x27274ba5bb951b92 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789265133.037640:0:5835:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1789265133.246428:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004913a6a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+5:5821:x1876180414234880:12345-0@lo:253: Request processed in 239445us (239707us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265133.246448:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789265133.246551:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000655adf84 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:5821:1876180414234880:0@lo:253: 10000000:01000000:0.0:1789265133.246566:0:5821:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789265133.246569:0:5821:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789265133.246571:0:5821:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789265133.246572:0:5821:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789265133.246573:0:5821:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1789265133.246574:0:5821:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789265133.246575:0:5821:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789265133.246577:0:5821:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789265133.246578:0:5821:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789265133.246580:0:5821:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1789265133.246581:0:5821:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789265133.246582:0:5821:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789265133.246599:0:5821:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000012cce23f from lustre-MDT0000 10000000:01000000:0.0:1789265133.246624:0:5821:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1789265133.246627:0:5821:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789265133.246631:0:5821:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8a10087899b8 10000000:01000000:0.0:1789265133.246635:0:5821:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789265133.246642:0:5821:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8a10087899b8 from 1 10000000:01000000:0.0:1789265133.246645:0:5821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789265133.246710:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: 000000009da760f6/0x27274ba5bb951b99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265133.246721:0:5821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: 000000009da760f6/0x27274ba5bb951b99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265133.246729:0:5821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: 000000009da760f6/0x27274ba5bb951b99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265133.246745:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006cad07f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:5821:1876180414235008:0@lo:101: 00000100:00100000:0.0:1789265133.246793:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265133.246853:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set 0000000046103d61 going to sleep for 11 seconds 00000100:00100000:1.0:1789265133.247002:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414235008 00000100:00100000:1.0:1789265133.247019:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414235008 00000100:00100000:1.0:1789265133.247058:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789265133.247065:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b194544f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+5:5821:x1876180414235008:12345-0@lo:101: 00010000:00010000:1.0:1789265133.247094:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265133.247106:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000035398f0/0x27274ba5bb951ba0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27274ba5bb951b99 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265133.247126:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000035398f0/0x27274ba5bb951ba0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27274ba5bb951b99 expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265133.247134:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000035398f0/0x27274ba5bb951ba0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb951b99 expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265133.247141:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000035398f0, rc 0) 00000100:00100000:1.0:1789265133.247181:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b194544f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+6:5821:x1876180414235008:12345-0@lo:101: Request processed in 116us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265133.247187:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789265133.247333:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006cad07f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:5821:1876180414235008:0@lo:101: 00010000:00010000:3.0:1789265133.247345:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: 000000009da760f6/0x27274ba5bb951b99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951ba0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265133.247353:0:5821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: 000000009da760f6/0x27274ba5bb951b99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27274ba5bb951ba0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265133.247397:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f43c1577 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:5821:1876180414235136:0@lo:501: 00000100:00100000:3.0:1789265133.247422:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265133.247449:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set 000000008a7172a7 going to sleep for 11 seconds 00000100:00100000:0.0:1789265133.247512:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414235136 00000100:00100000:0.0:1789265133.247518:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414235136 00000100:00100000:0.0:1789265133.247561:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789265133.247567:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007b1a5a8b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+6:5821:x1876180414235136:12345-0@lo:501: 00000100:00100000:0.0:1789265133.247929:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007b1a5a8b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+6:5821:x1876180414235136:12345-0@lo:501: Request processed in 362us (505us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789265133.247936:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789265133.248107:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f43c1577 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:5821:1876180414235136:0@lo:501: 10000000:01000000:3.0:1789265133.248135:0:5821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789265133.248248:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: 000000009da760f6/0x27274ba5bb951b99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951ba0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265133.248274:0:5821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: 000000009da760f6/0x27274ba5bb951b99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951ba0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265133.248282:0:5821:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8a10202ad000 10000000:01000000:3.0:1789265133.248285:0:5821:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789265133.248289:0:5821:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8a10202ad000 10000000:01000000:3.0:1789265133.248291:0:5821:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1789265133.248294:0:5821:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8a10202ad000 from 1 10000000:01000000:3.0:1789265133.248297:0:5821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1789265133.248319:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: 00000000b17cbd2e/0x27274ba5bb951ba7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265133.248327:0:5821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: 00000000b17cbd2e/0x27274ba5bb951ba7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265133.248334:0:5821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: 00000000b17cbd2e/0x27274ba5bb951ba7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265133.248346:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f43c1577 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:5821:1876180414235264:0@lo:101: 00000100:00100000:3.0:1789265133.248376:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265133.248405:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set 000000008a7172a7 going to sleep for 11 seconds 00000100:00100000:1.0:1789265133.248462:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414235264 00000100:00100000:1.0:1789265133.248468:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414235264 00000100:00100000:1.0:1789265133.248504:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789265133.248511:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006a30ce98 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+6:5821:x1876180414235264:12345-0@lo:101: 00010000:00010000:1.0:1789265133.248525:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265133.248534:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003cfe00ca/0x27274ba5bb951bae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27274ba5bb951ba7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265133.248551:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003cfe00ca/0x27274ba5bb951bae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27274ba5bb951ba7 expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265133.248558:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003cfe00ca/0x27274ba5bb951bae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb951ba7 expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265133.248565:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003cfe00ca, rc 0) 00000100:00100000:1.0:1789265133.248600:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006a30ce98 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+7:5821:x1876180414235264:12345-0@lo:101: Request processed in 91us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265133.248606:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789265133.248677:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f43c1577 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:5821:1876180414235264:0@lo:101: 00010000:00010000:3.0:1789265133.248698:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: 00000000b17cbd2e/0x27274ba5bb951ba7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951bae expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265133.248705:0:5821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: 00000000b17cbd2e/0x27274ba5bb951ba7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27274ba5bb951bae expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265133.248726:0:5821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789265133.248903:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: 00000000b17cbd2e/0x27274ba5bb951ba7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951bae expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265133.248911:0:5821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: 00000000b17cbd2e/0x27274ba5bb951ba7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951bae expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265133.248917:0:5821:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789265133.248921:0:5821:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789265133.248925:0:5821:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8a10202ad000 10000000:01000000:3.0:1789265133.248928:0:5821:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789265133.248931:0:5821:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1789265133.248932:0:5821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789265133.248946:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: 000000009458531e/0x27274ba5bb951bb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265133.248954:0:5821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: 000000009458531e/0x27274ba5bb951bb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265133.248960:0:5821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: 000000009458531e/0x27274ba5bb951bb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265133.248970:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f43c1577 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:5821:1876180414235392:0@lo:101: 00000100:00100000:3.0:1789265133.248997:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265133.249023:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set 000000008a7172a7 going to sleep for 11 seconds 00000100:00100000:1.0:1789265133.249134:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414235392 00000100:00100000:1.0:1789265133.249139:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414235392 00000100:00100000:1.0:1789265133.249170:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789265133.249177:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f33dbaba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+7:5821:x1876180414235392:12345-0@lo:101: 00010000:00010000:1.0:1789265133.249184:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265133.249193:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000058fe6439/0x27274ba5bb951bbc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x27274ba5bb951bb5 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265133.249206:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000058fe6439/0x27274ba5bb951bbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27274ba5bb951bb5 expref: 8 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265133.249213:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000058fe6439/0x27274ba5bb951bbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb951bb5 expref: 8 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265133.249218:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000058fe6439, rc 0) 00000100:00100000:1.0:1789265133.249274:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f33dbaba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+8:5821:x1876180414235392:12345-0@lo:101: Request processed in 97us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265133.249280:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789265133.249353:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f43c1577 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:5821:1876180414235392:0@lo:101: 00010000:00010000:2.0:1789265133.249363:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: 000000009458531e/0x27274ba5bb951bb5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951bbc expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265133.249369:0:5821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: 000000009458531e/0x27274ba5bb951bb5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x27274ba5bb951bbc expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265133.249426:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b8ffc8de pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:5821:1876180414235520:0@lo:501: 00000100:00100000:2.0:1789265133.249453:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265133.249474:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set 000000004b4f7f15 going to sleep for 11 seconds 00000100:00100000:2.0:1789265133.249486:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414235520 00000100:00100000:2.0:1789265133.249490:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414235520 00000100:00100000:2.0:1789265133.249520:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789265133.249526:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009fba2ee3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+8:5821:x1876180414235520:12345-0@lo:501: 00000100:00100000:2.0:1789265133.249799:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009fba2ee3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+9:5821:x1876180414235520:12345-0@lo:501: Request processed in 273us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265133.249806:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789265133.249836:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b8ffc8de pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:5821:1876180414235520:0@lo:501: 00000100:00100000:2.0:1789265133.249862:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b8ffc8de pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:5821:1876180414235648:0@lo:503: 00000100:00100000:2.0:1789265133.249896:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265133.249910:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set 000000004b4f7f15 going to sleep for 11 seconds 00000100:00100000:2.0:1789265133.249922:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414235648 00000100:00100000:2.0:1789265133.249925:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414235648 00000100:00100000:2.0:1789265133.249941:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789265133.249953:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cc5d3a36 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+9:5821:x1876180414235648:12345-0@lo:503: 00000100:00100000:2.0:1789265133.250287:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cc5d3a36 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+9:5821:x1876180414235648:12345-0@lo:503: Request processed in 334us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265133.250295:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789265133.250332:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b8ffc8de pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:5821:1876180414235648:0@lo:503: 00000100:00100000:1.0:1789265133.250887:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c98512ce pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:5864:1876180414235776:0@lo:502: 00000100:00100000:1.0:1789265133.250931:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265133.251000:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cd5438c8 going to sleep for 11 seconds 00000100:00100000:3.0:1789265133.251187:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414235776 00000100:00100000:3.0:1789265133.251194:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414235776 00000100:00100000:2.0:1789265133.251344:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789265133.251352:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005711087b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+9:5864:x1876180414235776:12345-0@lo:502: 00000100:00100000:2.0:1789265133.251528:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005711087b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+9:5864:x1876180414235776:12345-0@lo:502: Request processed in 176us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265133.251535:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789265133.251605:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c98512ce pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:5864:1876180414235776:0@lo:502: 00000020:01000000:1.0:1789265133.251631:0:5864:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789265133.251642:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265133.251644:0:5864:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789265133.251649:0:5864:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1789265133.251652:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789265133.251664:0:5864:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000008793f450) 00000020:00000080:1.0:1789265133.251679:0:5864:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1789265133.251697:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789265133.251762:0:5864:0:(osd_handler.c:1573:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789265133.251769:0:5864:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x27274ba5bb951bca 00000020:00000080:1.0:1789265133.251975:0:5864:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1789265133.251980:0:5864:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789265133.251983:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265133.251984:0:5864:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789265133.251987:0:5864:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789265133.251991:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265133.251992:0:5864:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1789265133.251995:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789265133.252001:0:5864:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000000915e409) 00000020:00000080:1.0:1789265133.252022:0:5864:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1789265133.252027:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1789265133.252029:0:5864:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1789265133.252031:0:5864:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1789265133.252037:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789265133.252126:0:5864:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000012cce23f from lustre-MDT0000, refs=3 00000020:00000080:1.0:1789265133.252139:0:5864:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000b3c9d9c6) 00000020:00000080:1.0:1789265133.252148:0:5864:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1789265133.252203:0:5864:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789265133.252210:0:5864:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x27274ba5bb951bdf 00000020:00000080:1.0:1789265133.252307:0:5864:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1789265133.252312:0:5864:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789265133.252316:0:5864:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x27274ba5bb951be6 00080000:01000000:1.0:1789265133.252320:0:5864:0:(osd_handler.c:1573:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789265133.252323:0:5864:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x27274ba5bb951bed 00080000:10000000:1.0:1789265133.252662:0:5864:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:1.0:1789265133.252839:0:5864:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1789265133.256901:0:5864:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1789265133.321995:0:5864:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1789265133.322858:0:5864:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1789265133.325664:0:5864:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1789265133.325968:0:5864:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789265133.362750:0:5864:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000002b12375f) 00000020:00000080:2.0:1789265133.362772:0:5864:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1789265133.362838:0:5864:0:(osd_handler.c:1573:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789265133.362844:0:5864:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x27274ba5bb951bfb 00000020:00000080:3.0:1789265133.365890:0:5864:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1789265133.369218:0:5864:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:1.0:1789265133.403219:0:5864:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1789265133.441951:0:5864:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1789265133.491318:0:5864:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:0.0:1789265133.521757:0:5864:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:2.0:1789265133.570569:0:5864:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1789265133.592210:0:5864:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x27274ba5bb951c02 00000020:00000080:2.0:1789265133.592746:0:5864:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1789265133.592757:0:5864:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265133.592763:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265133.592765:0:5864:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1789265133.592768:0:5864:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789265133.592772:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265133.592773:0:5864:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789265133.592776:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789265133.592777:0:5864:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789265133.592780:0:5864:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265133.592782:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265133.592783:0:5864:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789265133.592785:0:5864:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789265133.592796:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265133.592798:0:5864:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1789265133.592802:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1789265133.592837:0:5864:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1789265133.592930:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b8ffc8de pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:5864:1876180414235904:0@lo:502: 00000100:00100000:2.0:1789265133.593005:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265133.593217:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414235904 00000100:00100000:1.0:1789265133.593225:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414235904 00000100:00100000:1.0:1789265133.593273:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789265133.593282:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000012c69bd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+9:5864:x1876180414235904:12345-0@lo:502: 00000100:00100000:2.0:1789265133.593415:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d9efa035 going to sleep for 11 seconds 00000100:00100000:1.0:1789265133.593589:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000012c69bd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+9:5864:x1876180414235904:12345-0@lo:502: Request processed in 308us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265133.593596:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789265133.593727:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b8ffc8de pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:5864:1876180414235904:0@lo:502: 00000020:01000000:2.0:1789265133.593754:0:5864:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265133.593759:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265133.593761:0:5864:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:2.0:1789265133.593764:0:5864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1789265133.593931:0:5821:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1789265133.593949:0:5821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789265133.593973:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: 000000009458531e/0x27274ba5bb951bb5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951bbc expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265133.593984:0:5821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: 000000009458531e/0x27274ba5bb951bb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951bbc expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265133.593991:0:5821:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a10202ad000 from 1 10000000:01000000:0.0:1789265133.593994:0:5821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789265133.594019:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: 000000003b336206/0x27274ba5bb951c09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265133.594026:0:5821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: 000000003b336206/0x27274ba5bb951c09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265133.594034:0:5821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: 000000003b336206/0x27274ba5bb951c09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265133.594048:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b6f859af pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:5821:1876180414236032:0@lo:101: 00000100:00100000:0.0:1789265133.594098:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265133.594143:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set 000000006c80d73f going to sleep for 11 seconds 00000100:00100000:3.0:1789265133.594387:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414236032 00000100:00100000:3.0:1789265133.594393:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414236032 00000100:00100000:3.0:1789265133.594418:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789265133.594425:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b44352ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+9:5821:x1876180414236032:12345-0@lo:101: 00010000:00010000:3.0:1789265133.594434:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265133.594446:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e0a2a8a4/0x27274ba5bb951c10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27274ba5bb951c09 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265133.594466:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e0a2a8a4/0x27274ba5bb951c10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27274ba5bb951c09 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265133.594475:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e0a2a8a4/0x27274ba5bb951c10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb951c09 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265133.594484:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e0a2a8a4, rc 0) 00000100:00100000:3.0:1789265133.594525:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b44352ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+10:5821:x1876180414236032:12345-0@lo:101: Request processed in 101us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265133.594531:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789265133.594776:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b6f859af pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:5821:1876180414236032:0@lo:101: 00010000:00010000:2.0:1789265133.594787:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: 000000003b336206/0x27274ba5bb951c09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951c10 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265133.594796:0:5821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: 000000003b336206/0x27274ba5bb951c09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27274ba5bb951c10 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265133.596482:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000c922025 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:5821:1876180414236160:0@lo:256: 00000100:00100000:3.0:1789265133.596542:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265133.596737:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set 000000009c6c254b going to sleep for 11 seconds 00000100:00100000:1.0:1789265133.597070:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414236160 00000100:00100000:1.0:1789265133.597151:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414236160 00000100:00100000:1.0:1789265133.597203:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789265133.597212:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000075b53842 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+10:5821:x1876180414236160:12345-0@lo:256: 20000000:01000000:1.0:1789265133.597230:0:5834:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789265133.597237:0:5834:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1789265133.597450:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000075b53842 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+10:5821:x1876180414236160:12345-0@lo:256: Request processed in 240us (908us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265133.597462:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789265133.597521:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000c922025 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:5821:1876180414236160:0@lo:256: 10000000:01000000:0.0:1789265133.598271:0:5821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789265133.598292:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: 000000003b336206/0x27274ba5bb951c09 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951c10 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265133.598303:0:5821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: 000000003b336206/0x27274ba5bb951c09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951c10 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265133.598312:0:5821:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a10202ad000 from 1 10000000:01000000:0.0:1789265133.598315:0:5821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789265133.598351:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: 0000000024203588/0x27274ba5bb951c17 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265133.598359:0:5821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: 0000000024203588/0x27274ba5bb951c17 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265133.598367:0:5821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: 0000000024203588/0x27274ba5bb951c17 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265133.598381:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000054341829 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:5821:1876180414236288:0@lo:101: 00000100:00100000:0.0:1789265133.598419:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265133.598451:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set 000000006985b8d2 going to sleep for 11 seconds 00000100:00100000:2.0:1789265133.598505:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414236288 00000100:00100000:2.0:1789265133.598511:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414236288 00000100:00100000:2.0:1789265133.598582:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789265133.598589:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aca02f8a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+10:5821:x1876180414236288:12345-0@lo:101: 00010000:00010000:2.0:1789265133.598599:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265133.598613:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002d5d7289/0x27274ba5bb951c1e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27274ba5bb951c17 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265133.598632:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002d5d7289/0x27274ba5bb951c1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27274ba5bb951c17 expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265133.598648:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002d5d7289/0x27274ba5bb951c1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb951c17 expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265133.598656:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002d5d7289, rc 0) 00000100:00100000:2.0:1789265133.598702:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aca02f8a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+11:5821:x1876180414236288:12345-0@lo:101: Request processed in 114us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265133.598709:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789265133.598769:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000054341829 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:5821:1876180414236288:0@lo:101: 00010000:00010000:0.0:1789265133.598778:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: 0000000024203588/0x27274ba5bb951c17 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951c1e expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265133.598784:0:5821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: 0000000024203588/0x27274ba5bb951c17 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27274ba5bb951c1e expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265133.598828:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000054341829 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:5821:1876180414236416:0@lo:501: 00000100:00100000:0.0:1789265133.598849:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265133.598963:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set 000000006985b8d2 going to sleep for 11 seconds 00000100:00100000:3.0:1789265133.599029:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414236416 00000100:00100000:3.0:1789265133.599034:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414236416 00000100:00100000:3.0:1789265133.599059:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789265133.599065:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000037177e55 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+11:5821:x1876180414236416:12345-0@lo:501: 00000100:00100000:3.0:1789265133.599649:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000037177e55 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+11:5821:x1876180414236416:12345-0@lo:501: Request processed in 582us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265133.599657:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789265133.599781:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000054341829 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:5821:1876180414236416:0@lo:501: 00000100:00100000:0.0:1789265133.599812:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000054341829 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:5821:1876180414236544:0@lo:503: 00000100:00100000:0.0:1789265133.599848:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265133.599877:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set 000000006985b8d2 going to sleep for 11 seconds 00000100:00100000:2.0:1789265133.600044:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414236544 00000100:00100000:2.0:1789265133.600049:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414236544 00000100:00100000:2.0:1789265133.600117:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789265133.600125:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000000a44e46 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+11:5821:x1876180414236544:12345-0@lo:503: 00000040:00080000:2.0:1789265133.600160:0:5833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789265133.600196:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000000a44e46 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+11:5821:x1876180414236544:12345-0@lo:503: Request processed in 73us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265133.600203:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789265133.600282:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000054341829 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:5821:1876180414236544:0@lo:503: 00000040:00080000:3.0:1789265133.601346:0:5868:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1789265133.601504:0:5821:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1789265133.601522:0:5821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789265133.601570:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: 0000000024203588/0x27274ba5bb951c17 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951c1e expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265133.601582:0:5821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: 0000000024203588/0x27274ba5bb951c17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951c1e expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265133.601622:0:5821:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789265133.601624:0:5821:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8a10202ad000 10000000:01000000:0.0:1789265133.601627:0:5821:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8a10202ad000 10000000:01000000:0.0:1789265133.601631:0:5821:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789265133.601635:0:5821:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a10202ad000 from 1 10000000:01000000:0.0:1789265133.601637:0:5821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789265133.601663:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: 00000000426bb7a3/0x27274ba5bb951c25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265133.601670:0:5821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: 00000000426bb7a3/0x27274ba5bb951c25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265133.601749:0:5821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: 00000000426bb7a3/0x27274ba5bb951c25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265133.601764:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000054341829 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:5821:1876180414236672:0@lo:101: 00000100:00100000:0.0:1789265133.601814:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265133.601852:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set 000000006985b8d2 going to sleep for 11 seconds 00000100:00100000:3.0:1789265133.601906:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414236672 00000100:00100000:3.0:1789265133.601911:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414236672 00000100:00100000:3.0:1789265133.601951:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789265133.601959:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005ea2705d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+11:5821:x1876180414236672:12345-0@lo:101: 00010000:00010000:3.0:1789265133.601969:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265133.601979:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000073c752c7/0x27274ba5bb951c2c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x27274ba5bb951c25 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265133.601999:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000073c752c7/0x27274ba5bb951c2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27274ba5bb951c25 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265133.602008:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000073c752c7/0x27274ba5bb951c2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb951c25 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265133.602015:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000073c752c7, rc 0) 00000100:00100000:3.0:1789265133.602060:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005ea2705d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+12:5821:x1876180414236672:12345-0@lo:101: Request processed in 102us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265133.602066:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789265133.602304:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000054341829 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:5821:1876180414236672:0@lo:101: 00010000:00010000:1.0:1789265133.602318:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: 00000000426bb7a3/0x27274ba5bb951c25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951c2c expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265133.602326:0:5821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: 00000000426bb7a3/0x27274ba5bb951c25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x27274ba5bb951c2c expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265133.602374:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c98512ce pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:5821:1876180414236800:0@lo:501: 00000100:00100000:1.0:1789265133.602403:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265133.602430:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set 0000000096915e32 going to sleep for 11 seconds 00000100:00100000:3.0:1789265133.602475:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414236800 00000100:00100000:3.0:1789265133.602480:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414236800 00000100:00100000:3.0:1789265133.602509:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789265133.602515:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000088a75650 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+12:5821:x1876180414236800:12345-0@lo:501: 00000100:00100000:3.0:1789265133.602845:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000088a75650 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+12:5821:x1876180414236800:12345-0@lo:501: Request processed in 330us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265133.602863:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789265133.602930:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c98512ce pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:5821:1876180414236800:0@lo:501: 00000100:00100000:1.0:1789265133.602955:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c98512ce pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:5821:1876180414236928:0@lo:503: 00000100:00100000:1.0:1789265133.602990:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265133.603009:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set 0000000096915e32 going to sleep for 11 seconds 00000100:00100000:0.0:1789265133.603062:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414236928 00000100:00100000:0.0:1789265133.603067:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414236928 00000100:00100000:0.0:1789265133.603130:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789265133.603136:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000026da8b8e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+12:5821:x1876180414236928:12345-0@lo:503: 00000100:00100000:0.0:1789265133.603414:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000026da8b8e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+12:5821:x1876180414236928:12345-0@lo:503: Request processed in 278us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265133.603421:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789265133.603589:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c98512ce pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:5821:1876180414236928:0@lo:503: 00000100:00100000:1.0:1789265133.604010:0:5869:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c98512ce pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:5869:1876180414237056:0@lo:502: 00000100:00100000:1.0:1789265133.604046:0:5869:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265133.604178:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414237056 00000100:00100000:3.0:1789265133.604183:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414237056 00000100:00100000:3.0:1789265133.604221:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789265133.604228:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b446f732 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+12:5869:x1876180414237056:12345-0@lo:502: 00000100:00100000:3.0:1789265133.604428:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b446f732 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+12:5869:x1876180414237056:12345-0@lo:502: Request processed in 200us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265133.604436:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789265133.604490:0:5869:0:(client.c:2715:ptlrpc_set_wait()) set 0000000018be1882 going to sleep for 11 seconds 00000100:00100000:1.0:1789265133.604505:0:5869:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c98512ce pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:5869:1876180414237056:0@lo:502: 00000020:01000004:1.0:1789265133.604555:0:5869:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1789265133.604577:0:5869:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000dc945567) 00000020:00000080:1.0:1789265133.604595:0:5869:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1789265133.604661:0:5869:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000012cce23f from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789265133.604666:0:5869:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000012cce23f from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789265133.604673:0:5869:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000012cce23f 4 00010000:00080000:1.0:1789265133.604805:0:5869:0:(ldlm_lib.c:102:import_set_conn()) imp 000000009f7c1916@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.137@tcp at head 00010000:00010000:0.0:1789265133.610454:0:5869:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1789265133.610827:0:5869:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1789265133.610868:0:5869:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789265133.610880:0:5869:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x27274ba5bb951c3a 00000100:00080000:0.0:1789265133.610891:0:5869:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789265133.610896:0:5869:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000009f7c1916 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:0.0:1789265133.610928:0:5869:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000772bbd1b x1876180414237184/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789265133.610945:0:5869:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789265133.611032:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000772bbd1b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876180414237184:0@lo:38: 00000100:00100000:1.0:1789265133.611115:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265133.611179:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414237184 00000100:00100000:1.0:1789265133.611186:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414237184 00000100:00100000:1.0:1789265133.611216:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789265133.611222:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c98512ce pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3314:x1876180414237184:12345-0@lo:38: 00000100:00100000:1.0:1789265133.611279:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c98512ce pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3314:x1876180414237184:12345-0@lo:38: Request processed in 55us (163us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789265133.611285:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789265133.611319:0:3314:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789265133.611325:0:3314:0:(import.c:65:import_set_state_nolock()) 000000009f7c1916 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789265133.611329:0:3314:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789265133.611332:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000772bbd1b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876180414237184:0@lo:38: 00000100:00100000:0.0:1789265133.619534:0:5869:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000eeb6adbb pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:5869:1876180414237312:0@lo:502: 00000100:00100000:0.0:1789265133.619800:0:5869:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265133.619863:0:5869:0:(client.c:2715:ptlrpc_set_wait()) set 000000006985b8d2 going to sleep for 11 seconds 00000100:00100000:3.0:1789265133.619886:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414237312 00000100:00100000:3.0:1789265133.619894:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414237312 00000100:00100000:3.0:1789265133.619940:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789265133.619947:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ad8e56e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+12:5869:x1876180414237312:12345-0@lo:502: 00000100:00100000:3.0:1789265133.621433:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ad8e56e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+12:5869:x1876180414237312:12345-0@lo:502: Request processed in 1478us (1625us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265133.621445:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789265133.621594:0:5869:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000eeb6adbb pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:5869:1876180414237312:0@lo:502: 00000040:00080000:0.0:1789265133.621639:0:5869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1789265133.621766:0:5821:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1789265133.621785:0:5821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789265133.621804:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: 00000000426bb7a3/0x27274ba5bb951c25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951c2c expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265133.621814:0:5821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: 00000000426bb7a3/0x27274ba5bb951c25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951c2c expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789265133.621864:0:5821:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789265133.621866:0:5821:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789265133.621868:0:5821:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789265133.621869:0:5821:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789265133.621870:0:5821:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789265133.621872:0:5821:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789265133.621873:0:5821:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789265133.621874:0:5821:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789265133.621876:0:5821:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789265133.621877:0:5821:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789265133.621879:0:5821:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789265133.621880:0:5821:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789265133.621883:0:5821:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1789265133.621885:0:5821:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789265133.621887:0:5821:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789265133.621887:0:5821:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789265133.621888:0:5821:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789265133.621889:0:5821:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789265133.621890:0:5821:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789265133.621891:0:5821:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789265133.621892:0:5821:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789265133.621892:0:5821:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789265133.621893:0:5821:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789265133.621894:0:5821:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789265133.621895:0:5821:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789265133.621911:0:5821:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789265133.621921:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000eeb6adbb pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:5821:1876180414237440:0@lo:253: 00000100:00100000:0.0:1789265133.621964:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265133.621998:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set 000000006aab493d going to sleep for 11 seconds 00000100:00100000:3.0:1789265133.622287:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414237440 00000100:00100000:3.0:1789265133.622294:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414237440 00000100:00100000:3.0:1789265133.622334:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789265133.622341:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004953856e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+12:5821:x1876180414237440:12345-0@lo:253: 20000000:01000000:3.0:1789265133.622373:0:5835:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789265133.622386:0:5835:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789265133.660945:0:5835:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789265133.660965:0:5835:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1789265133.661522:0:5856:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789265133.661528:0:5856:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789265133.661549:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000f6346faa/0x27274ba5bb951c41 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265133.661580:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000e0a2a8a4/0x27274ba5bb951c10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb951c09 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265133.661588:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000f6346faa/0x27274ba5bb951c41 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265133.661625:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000e0a2a8a4/0x27274ba5bb951c10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27274ba5bb951c09 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265133.661640:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000e0a2a8a4/0x27274ba5bb951c10 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27274ba5bb951c09 expref: 12 pid: 5835 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265133.661653:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ac572942 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5856:1876180414237568:0@lo:104: 00000100:00100000:0.0:1789265133.661722:0:5856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265133.661777:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set 00000000347351c8 going to sleep for 11 seconds 00000100:00100000:2.0:1789265133.662194:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414237568 00000100:00100000:2.0:1789265133.662202:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414237568 00000100:00100000:2.0:1789265133.662260:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789265133.662269:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000064722386 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:871daf34-1206-40e7-bd71-78303abe4d37+3:5856:x1876180414237568:12345-0@lo:104: 00010000:00010000:2.0:1789265133.662281:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: 000000003b336206/0x27274ba5bb951c09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27274ba5bb951c10 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265133.662339:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789265133.662344:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000064722386 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:871daf34-1206-40e7-bd71-78303abe4d37+3:5856:x1876180414237568:12345-0@lo:104: Request processed in 77us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265133.662369:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1789265133.662395:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265133.662400:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: 000000003b336206/0x27274ba5bb951c09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27274ba5bb951c10 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265133.662408:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003b336206 already unused, calling callback (00000000d72d8376) 10000000:00010000:2.0:1789265133.662412:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: 000000003b336206/0x27274ba5bb951c09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x27274ba5bb951c10 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265133.662419:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: 000000003b336206/0x27274ba5bb951c09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x27274ba5bb951c10 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265133.662426:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: 000000003b336206/0x27274ba5bb951c09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x27274ba5bb951c10 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265133.662432:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789265133.662460:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: 000000003b336206/0x27274ba5bb951c09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951c10 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265133.662466:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265133.662485:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: 000000003b336206/0x27274ba5bb951c09 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951c10 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265133.662491:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: 000000003b336206/0x27274ba5bb951c09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951c10 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265133.662994:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265133.662996:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265133.662998:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265133.663238:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b8ffc8de pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:871daf34-1206-40e7-bd71-78303abe4d37:3316:1876180414237696:0@lo:103: 00000100:00100000:1.0:1789265133.663295:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265133.663366:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414237696 00000100:00100000:1.0:1789265133.663372:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414237696 00010000:00010000:1.0:1789265133.663392:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000e0a2a8a4/0x27274ba5bb951c10 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27274ba5bb951c09 expref: 13 pid: 5835 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265133.663415:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789265133.663421:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007eac62ec pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:871daf34-1206-40e7-bd71-78303abe4d37+13:3316:x1876180414237696:12345-0@lo:103: 00010000:00010000:1.0:1789265133.663431:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265133.663434:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000e0a2a8a4/0x27274ba5bb951c10 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27274ba5bb951c09 expref: 13 pid: 5835 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265133.663453:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000e0a2a8a4/0x27274ba5bb951c10 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27274ba5bb951c09 expref: 13 pid: 5835 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265133.663469:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000f6346faa/0x27274ba5bb951c41 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265133.663475:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f6346faa/0x27274ba5bb951c41 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789265133.663488:0:5825:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001960780s 00010000:00010000:1.0:1789265133.663492:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f6346faa/0x27274ba5bb951c41 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265133.663497:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f6346faa/0x27274ba5bb951c41 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265133.663501:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000f6346faa/0x27274ba5bb951c41 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265133.663506:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000f6346faa/0x27274ba5bb951c41 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265133.663512:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f6346faa already unused, calling callback (000000009c5d5074) 00010000:00010000:1.0:1789265133.663515:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000f6346faa/0x27274ba5bb951c41 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265133.663521:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000f6346faa/0x27274ba5bb951c41 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265133.663528:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000f6346faa/0x27274ba5bb951c41 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265133.663548:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789265133.663819:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e0a2a8a4/0x27274ba5bb951c10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27274ba5bb951c09 expref: 13 pid: 5835 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265133.663840:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ac572942 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5856:1876180414237568:0@lo:104: 00010000:00010000:0.0:1789265133.663857:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000f6346faa/0x27274ba5bb951c41 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265133.663864:0:5856:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000f6346faa/0x27274ba5bb951c41 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265133.663876:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000f6346faa/0x27274ba5bb951c41 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265133.663881:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f6346faa/0x27274ba5bb951c41 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265133.665200:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007eac62ec pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:871daf34-1206-40e7-bd71-78303abe4d37+12:3316:x1876180414237696:12345-0@lo:103: Request processed in 1775us (1900us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265133.665212:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789265133.665328:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b8ffc8de pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:871daf34-1206-40e7-bd71-78303abe4d37:3316:1876180414237696:0@lo:103: 00000100:00100000:0.0:1789265133.674381:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004953856e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+11:5821:x1876180414237440:12345-0@lo:253: Request processed in 52032us (52408us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265133.674397:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789265133.674530:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000eeb6adbb pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:5821:1876180414237440:0@lo:253: 10000000:01000000:1.0:1789265133.674544:0:5821:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789265133.674547:0:5821:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789265133.674613:0:5821:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789265133.674615:0:5821:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789265133.674616:0:5821:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789265133.674617:0:5821:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789265133.674619:0:5821:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789265133.674620:0:5821:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789265133.674621:0:5821:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789265133.674623:0:5821:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789265133.674624:0:5821:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789265133.674625:0:5821:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789265133.674626:0:5821:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789265133.674639:0:5821:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789265133.683446:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1789265133.684172:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789265133.684409:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1789265133.684777:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789265133.684981:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1789265133.685192:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1789265133.686292:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1789265133.686464:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1789265133.686860:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1789265133.687058:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1789265133.687399:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1789265133.687787:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:2.0:1789265133.740109:0:5821:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000020:00080000:1.0:1789265133.789829:0:5874:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1789265133.789835:0:5874:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1789265133.789872:0:5821:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1789265133.794427:0:5875:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1789265133.800746:0:5821:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1789265133.801303:0:5821:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1789265133.801717:0:5821:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1789265133.801727:0:5821:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1789265133.801863:0:5821:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789265133.808571:0:5821:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1789265133.809181:0:5821:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789265133.809214:0:5821:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1789265133.809517:0:5821:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1789265133.809702:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1789265133.810853:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1789265133.811005:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1789265133.811170:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1789265133.811918:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1789265133.815421:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1789265133.815813:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1789265133.815990:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1789265133.816165:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1789265133.816309:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1789265133.816460:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1789265133.816596:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1789265133.819482:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1789265133.819670:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1789265133.820532:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1789265133.820699:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1789265133.820878:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1789265133.821181:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1789265133.821500:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1789265133.821632:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1789265133.821792:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1789265133.821944:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1789265133.822134:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1789265133.822318:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1789265133.822473:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1789265133.822618:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1789265133.822788:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1789265133.822930:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1789265133.823115:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1789265133.823277:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1789265133.823426:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1789265133.823592:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1789265133.823742:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1789265133.823920:0:5821:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1789265133.833962:0:5875:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00010000:00010000:3.0:1789265133.874773:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789265133.899617:0:5821:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1789265133.899646:0:5821:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa47541973988 00100000:10000000:0.0:1789265133.899653:0:5821:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000040:00080000:1.0:1789265133.906690:0:5875:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789265133.906781:0:5875:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789265133.906786:0:5875:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:01000004:0.0:1789265133.911777:0:5821:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789265133.911795:0:5821:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.137@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789265133.911808:0:5821:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1789265133.911833:0:5821:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1789265134.899174:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265135.922385:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265136.946342:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789265137.595561:0:6117:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg337-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789265137.970588:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265138.995164:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789265138.997120:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789265138.997129:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789265138.997132:0:37:0:(import.c:65:import_set_state_nolock()) 000000009f7c1916 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789265138.997144:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000009f7c1916 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:2.0:1789265138.997166:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000084ebe1f x1876180414237952/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789265138.997199:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000084ebe1f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876180414237952:0@lo:38: 00000100:00100000:2.0:1789265138.997306:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265138.999154:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789265138.999172:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b8ffc8de pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:871daf34-1206-40e7-bd71-78303abe4d37:3318:1876180414237824:0@lo:400: 00000100:00100000:1.0:1789265138.999244:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265138.999308:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414237952 00000100:00100000:1.0:1789265138.999314:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414237952 00000100:00100000:1.0:1789265138.999342:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789265138.999348:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009ab8b5cb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3314:x1876180414237952:12345-0@lo:38: 00010000:00080000:1.0:1789265138.999372:0:5842:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 184 last 0 00000020:00000080:1.0:1789265138.999402:0:5842:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x27274ba5bb951c48 00000004:00100000:1.0:1789265138.999574:0:5842:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789265138.999697:0:5842:0:(import.c:65:import_set_state_nolock()) 000000008ef1cfdd : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789265138.999754:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009ab8b5cb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876180414237952:12345-0@lo:38: Request processed in 404us (2448us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265138.999762:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789265138.999794:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414237824 00000100:00100000:1.0:1789265138.999798:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414237824 00000100:00100000:1.0:1789265138.999824:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789265138.999830:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fd4f5d0c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+11:3318:x1876180414237824:12345-0@lo:400: 00000100:00100000:1.0:1789265138.999916:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fd4f5d0c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+11:3318:x1876180414237824:12345-0@lo:400: Request processed in 86us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265138.999923:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1789265138.999969:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000084ebe1f x1876180414237952/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789265148 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789265138.999986:0:3314:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1789265138.999994:0:3314:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789265138.999999:0:3314:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789265139.000000:0:3314:0:(import.c:65:import_set_state_nolock()) 000000009f7c1916 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789265139.000006:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000084ebe1f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876180414237952:0@lo:38: 00000100:00100000:1.0:1789265139.000034:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b8ffc8de pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:871daf34-1206-40e7-bd71-78303abe4d37:3318:1876180414237824:0@lo:400: 00010000:00010000:3.0:1789265140.018792:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265141.043367:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265142.069321:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789265142.286040:0:6319:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd19e48be0 20000000:00000080:0.0:1789265142.286057:0:6319:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8a1009130400 uarg=0000000000000000 20000000:01000000:0.0:1789265142.286112:0:6319:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1789265142.286119:0:6319:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1789265142.286124:0:6319:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1789265142.286329:0:6319:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1789265142.286339:0:6319:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1789265142.294031:0:6319:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789265142.294380:0:6319:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789265142.294529:0:6319:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1789265142.294582:0:6319:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1789265142.294601:0:6319:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789265142.295226:0:6319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000a8bb77d8/0x27274ba5bb951c4f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265142.295251:0:6319:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000002d5d7289/0x27274ba5bb951c1e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb951c17 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265142.295257:0:6319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000a8bb77d8/0x27274ba5bb951c4f lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265142.295293:0:6319:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000002d5d7289/0x27274ba5bb951c1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27274ba5bb951c17 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265142.295307:0:6319:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000002d5d7289/0x27274ba5bb951c1e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27274ba5bb951c17 expref: 10 pid: 5833 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265142.295320:0:6319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ac572942 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6319:1876180414238080:0@lo:104: 00000100:00100000:0.0:1789265142.295378:0:6319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265142.295425:0:6319:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e82535fc going to sleep for 11 seconds 00000100:00100000:3.0:1789265142.295498:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414238080 00000100:00100000:3.0:1789265142.295506:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414238080 00000100:00100000:3.0:1789265142.295553:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789265142.295561:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000011f2293f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:871daf34-1206-40e7-bd71-78303abe4d37+3:6319:x1876180414238080:12345-0@lo:104: 00010000:00010000:3.0:1789265142.295583:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: 0000000024203588/0x27274ba5bb951c17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27274ba5bb951c1e expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265142.295645:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789265142.295650:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000011f2293f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:871daf34-1206-40e7-bd71-78303abe4d37+3:6319:x1876180414238080:12345-0@lo:104: Request processed in 91us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265142.295657:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1789265142.295683:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265142.295690:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: 0000000024203588/0x27274ba5bb951c17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27274ba5bb951c1e expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265142.295697:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000024203588 already unused, calling callback (00000000d72d8376) 10000000:00010000:1.0:1789265142.295700:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: 0000000024203588/0x27274ba5bb951c17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x27274ba5bb951c1e expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265142.295707:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: 0000000024203588/0x27274ba5bb951c17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x27274ba5bb951c1e expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265142.295712:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: 0000000024203588/0x27274ba5bb951c17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x27274ba5bb951c1e expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265142.295718:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789265142.295748:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: 0000000024203588/0x27274ba5bb951c17 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951c1e expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265142.295755:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789265142.295779:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000081b9f8e8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:871daf34-1206-40e7-bd71-78303abe4d37:3318:1876180414238208:0@lo:103: 00000100:00100000:3.0:1789265142.295816:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789265142.295830:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: 0000000024203588/0x27274ba5bb951c17 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951c1e expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265142.295837:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: 0000000024203588/0x27274ba5bb951c17 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951c1e expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265142.295852:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265142.295854:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265142.295855:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265142.295862:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414238208 00000100:00100000:3.0:1789265142.295866:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414238208 00010000:00010000:3.0:1789265142.295880:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000002d5d7289/0x27274ba5bb951c1e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27274ba5bb951c17 expref: 11 pid: 5833 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265142.295881:0:6319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ac572942 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6319:1876180414238080:0@lo:104: 00000100:00100000:3.0:1789265142.295901:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1789265142.295905:0:6319:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000a8bb77d8/0x27274ba5bb951c4f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265142.295906:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000617deb48 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:871daf34-1206-40e7-bd71-78303abe4d37+11:3318:x1876180414238208:12345-0@lo:103: 00010000:00010000:3.0:1789265142.295915:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265142.295919:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000002d5d7289/0x27274ba5bb951c1e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27274ba5bb951c17 expref: 11 pid: 5833 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265142.295928:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000002d5d7289/0x27274ba5bb951c1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27274ba5bb951c17 expref: 11 pid: 5833 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265142.295939:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002d5d7289/0x27274ba5bb951c1e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27274ba5bb951c17 expref: 11 pid: 5833 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265142.295951:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000a8bb77d8/0x27274ba5bb951c4f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265142.295957:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a8bb77d8/0x27274ba5bb951c4f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265142.296457:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a8bb77d8/0x27274ba5bb951c4f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265142.296466:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a8bb77d8/0x27274ba5bb951c4f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265142.296473:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000a8bb77d8/0x27274ba5bb951c4f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265142.296640:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000a8bb77d8/0x27274ba5bb951c4f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265142.296649:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a8bb77d8 already unused, calling callback (000000009c5d5074) 00010000:00010000:3.0:1789265142.296653:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000a8bb77d8/0x27274ba5bb951c4f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265142.296659:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000a8bb77d8/0x27274ba5bb951c4f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265142.296679:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000a8bb77d8/0x27274ba5bb951c4f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265142.296688:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789265142.296726:0:6319:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000a8bb77d8/0x27274ba5bb951c4f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265142.296728:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000617deb48 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:871daf34-1206-40e7-bd71-78303abe4d37+10:3318:x1876180414238208:12345-0@lo:103: Request processed in 821us (911us total) trans 0 rc 0/0 00010000:00010000:0.0:1789265142.296734:0:6319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000a8bb77d8/0x27274ba5bb951c4f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265142.296735:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1789265142.296739:0:6319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a8bb77d8/0x27274ba5bb951c4f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265142.296811:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000081b9f8e8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:871daf34-1206-40e7-bd71-78303abe4d37:3318:1876180414238208:0@lo:103: 10000000:01000000:3.0:1789265142.802761:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789265142.802773:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a10202ad000 from 3 10000000:01000000:3.0:1789265142.802780:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789265142.802847:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: 000000002d93fbb7/0x27274ba5bb951c56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265142.802861:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: 000000002d93fbb7/0x27274ba5bb951c56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265142.802873:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: 000000002d93fbb7/0x27274ba5bb951c56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265142.802904:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003c8357a8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414238336:0@lo:101: 00000100:00100000:3.0:1789265142.803023:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265142.803116:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d7df3bc6 going to sleep for 11 seconds 00000100:00100000:0.0:1789265142.803211:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414238336 00000100:00100000:0.0:1789265142.803221:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414238336 00000100:00100000:0.0:1789265142.803285:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789265142.803295:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ab971cd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+10:5837:x1876180414238336:12345-0@lo:101: 00010000:00010000:0.0:1789265142.803312:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265142.803334:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a8bb77d8/0x27274ba5bb951c5d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27274ba5bb951c56 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265142.803364:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a8bb77d8/0x27274ba5bb951c5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27274ba5bb951c56 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265142.803375:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a8bb77d8/0x27274ba5bb951c5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb951c56 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265142.803385:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a8bb77d8, rc 0) 00000100:00100000:0.0:1789265142.803438:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ab971cd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+11:5837:x1876180414238336:12345-0@lo:101: Request processed in 144us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265142.803446:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789265142.804111:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003c8357a8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414238336:0@lo:101: 00010000:00010000:3.0:1789265142.804133:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: 000000002d93fbb7/0x27274ba5bb951c56 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951c5d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265142.804144:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: 000000002d93fbb7/0x27274ba5bb951c56 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27274ba5bb951c5d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265142.804229:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003c8357a8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414238464:0@lo:256: 00000100:00100000:3.0:1789265142.804282:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265142.804323:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d7df3bc6 going to sleep for 11 seconds 00000100:00100000:0.0:1789265142.804401:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414238464 00000100:00100000:0.0:1789265142.804408:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414238464 00000100:00100000:0.0:1789265142.804455:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789265142.804462:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004f355136 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+11:5837:x1876180414238464:12345-0@lo:256: 20000000:01000000:0.0:1789265142.804482:0:5833:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789265142.804500:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789265142.804503:0:5833:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1789265142.804600:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004f355136 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+11:5837:x1876180414238464:12345-0@lo:256: Request processed in 139us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265142.804608:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789265142.804752:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003c8357a8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414238464:0@lo:256: 10000000:01000000:1.0:1789265142.804813:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789265142.804822:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: 000000002d93fbb7/0x27274ba5bb951c56 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951c5d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265142.804832:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: 000000002d93fbb7/0x27274ba5bb951c56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951c5d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265142.804843:0:5837:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789265142.804847:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a10202ad000 from 1 10000000:01000000:1.0:1789265142.804851:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789265142.804880:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: 000000004f4ea0eb/0x27274ba5bb951c64 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265142.804889:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: 000000004f4ea0eb/0x27274ba5bb951c64 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265142.804897:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: 000000004f4ea0eb/0x27274ba5bb951c64 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265142.804912:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000072c6e0d7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414238592:0@lo:101: 00000100:00100000:1.0:1789265142.804946:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265142.805123:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set 000000002bae4426 going to sleep for 11 seconds 00000100:00100000:0.0:1789265142.808317:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414238592 00000100:00100000:0.0:1789265142.808339:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414238592 00000100:00100000:0.0:1789265142.808412:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789265142.808424:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007be2fdf0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+11:5837:x1876180414238592:12345-0@lo:101: 00010000:00010000:0.0:1789265142.808449:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265142.808475:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003a7dcd8b/0x27274ba5bb951c6b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27274ba5bb951c64 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265142.808522:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003a7dcd8b/0x27274ba5bb951c6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27274ba5bb951c64 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265142.808534:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003a7dcd8b/0x27274ba5bb951c6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb951c64 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265142.808545:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003a7dcd8b, rc 0) 00000100:00100000:0.0:1789265142.809297:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007be2fdf0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+12:5837:x1876180414238592:12345-0@lo:101: Request processed in 872us (4347us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265142.809307:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789265142.809466:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000072c6e0d7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414238592:0@lo:101: 00010000:00010000:1.0:1789265142.809490:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: 000000004f4ea0eb/0x27274ba5bb951c64 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951c6b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265142.809514:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: 000000004f4ea0eb/0x27274ba5bb951c64 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27274ba5bb951c6b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265142.809605:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000072c6e0d7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414238720:0@lo:501: 00000100:00100000:1.0:1789265142.809669:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265142.809723:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set 000000002bae4426 going to sleep for 11 seconds 00000100:00100000:0.0:1789265142.809842:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414238720 00000100:00100000:0.0:1789265142.809849:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414238720 00000100:00100000:0.0:1789265142.809891:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789265142.809899:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000054952e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+12:5837:x1876180414238720:12345-0@lo:501: 00000100:00100000:0.0:1789265142.810262:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000054952e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+12:5837:x1876180414238720:12345-0@lo:501: Request processed in 364us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265142.810271:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789265142.810365:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000072c6e0d7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414238720:0@lo:501: 00000100:00100000:1.0:1789265142.810397:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000072c6e0d7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414238848:0@lo:503: 00000100:00100000:1.0:1789265142.810441:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265142.810468:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set 000000002bae4426 going to sleep for 11 seconds 00000100:00100000:0.0:1789265142.810523:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414238848 00000100:00100000:0.0:1789265142.810528:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414238848 00000100:00100000:0.0:1789265142.810560:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789265142.810567:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d43dda2d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+12:5837:x1876180414238848:12345-0@lo:503: 00000100:00100000:0.0:1789265142.811384:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d43dda2d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+12:5837:x1876180414238848:12345-0@lo:503: Request processed in 814us (940us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265142.811394:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789265142.812779:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000072c6e0d7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414238848:0@lo:503: 00000100:00100000:0.0:1789265142.814801:0:6335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001ac5422e pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:6335:1876180414238976:0@lo:502: 00000100:00100000:0.0:1789265142.814920:0:6335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265142.814995:0:6335:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e82535fc going to sleep for 11 seconds 00000100:00100000:1.0:1789265142.815058:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414238976 00000100:00100000:1.0:1789265142.815067:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414238976 00000100:00100000:1.0:1789265142.815151:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789265142.815161:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002826093b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+12:6335:x1876180414238976:12345-0@lo:502: 00000100:00100000:1.0:1789265142.815406:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002826093b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+12:6335:x1876180414238976:12345-0@lo:502: Request processed in 245us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265142.815415:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789265142.817730:0:6335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001ac5422e pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:6335:1876180414238976:0@lo:502: 00000020:01000000:2.0:1789265142.817793:0:6335:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789265142.817807:0:6335:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265142.817811:0:6335:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789265142.817820:0:6335:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a10202ad000 00000020:00000080:2.0:1789265142.817823:0:6335:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789265142.817904:0:6335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:6335:1876180414239104:0@lo:502: 00000100:00100000:2.0:1789265142.818000:0:6335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265142.818044:0:6335:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10119509c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265142.818356:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414239104 00000100:00100000:0.0:1789265142.818366:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414239104 00000100:00100000:0.0:1789265142.818439:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789265142.818449:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+12:6335:x1876180414239104:12345-0@lo:502: 00000100:00100000:0.0:1789265142.818846:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+12:6335:x1876180414239104:12345-0@lo:502: Request processed in 397us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265142.818853:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789265142.819037:0:6335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:6335:1876180414239104:0@lo:502: 00000020:01000000:2.0:1789265142.819152:0:6335:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265142.819162:0:6335:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265142.819164:0:6335:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789265142.819170:0:6335:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1789265142.821385:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789265142.821430:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789265142.821445:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a101b596600/0x27274ba5bb951c64 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951c6b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265142.821463:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff8a101b596600/0x27274ba5bb951c64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951c6b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265143.098361:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265144.120142:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265144.120474:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c07a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876180414239360:0@lo:400: 00000100:00100000:0.0:1789265144.120544:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265144.120596:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789265144.120602:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c078e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:871daf34-1206-40e7-bd71-78303abe4d37:3316:1876180414239232:0@lo:400: 00000100:00100000:0.0:1789265144.120640:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265144.120678:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414239360 00000100:00100000:0.0:1789265144.120685:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414239360 00000100:00100000:0.0:1789265144.120724:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789265144.120733:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c078700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876180414239360:12345-0@lo:400: 00000100:00100000:0.0:1789265144.120780:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c078700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876180414239360:12345-0@lo:400: Request processed in 48us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265144.120787:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789265144.120809:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414239232 00000100:00100000:0.0:1789265144.120813:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414239232 00000100:00100000:0.0:1789265144.120834:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789265144.120841:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+12:3316:x1876180414239232:12345-0@lo:400: 00000100:00100000:0.0:1789265144.120873:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+12:3316:x1876180414239232:12345-0@lo:400: Request processed in 33us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265144.120879:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789265144.120932:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c078e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:871daf34-1206-40e7-bd71-78303abe4d37:3316:1876180414239232:0@lo:400: 00010000:00080000:0.0:1789265144.120944:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8a103c07a680 x1876180414239360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265144.120954:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c07a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876180414239360:0@lo:400: 00010000:00010000:0.0:1789265145.143039:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265146.166654:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265147.192945:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789265147.926691:0:6680:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789265147.926696:0:6680:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1789265147.926812:0:6680:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8a103c151000 00000020:01000004:1.0:1789265147.926828:0:6680:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1789265147.926838:0:6680:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1789265147.926851:0:6680:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8a10037d19b8) 00000020:00000080:1.0:1789265147.926866:0:6680:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1789265147.943280:0:6680:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1789265147.943781:0:6680:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1789265147.976259:0:6680:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1789265147.981696:0:6680:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789265147.981738:0:6680:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1789265147.981804:0:6680:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789265147.981833:0:6680:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1789265147.982191:0:6680:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1789265147.982202:0:6680:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789265147.982212:0:6680:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x27274ba5bb951c79 00000020:01000004:2.0:1789265147.982220:0:6680:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1789265147.982241:0:6680:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.137@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789265147.982244:0:6680:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.137@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789265147.982249:0:6680:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1789265147.982253:0:6680:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1789265147.982271:0:6680:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8a1008f40000) 00000020:00000080:2.0:1789265147.982281:0:6680:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1789265147.983509:0:6680:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789265147.983681:0:6680:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1789265147.983687:0:6680:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1789265147.984701:0:6680:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1789265147.985124:0:6680:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1789265147.986748:0:6680:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1789265147.986765:0:6680:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1789265147.992619:0:6680:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789265147.992823:0:6680:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1789265147.992830:0:6680:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1789265147.993707:0:6680:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1789265147.993715:0:6680:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1789265148.019552:0:6680:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789265148.020271:0:6680:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789265148.020278:0:6680:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1789265148.024275:0:6680:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789265148.024292:0:6680:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1789265148.026030:0:6680:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789265148.026043:0:6680:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1789265148.031658:0:6680:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789265148.032243:0:6680:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1789265148.032249:0:6680:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1789265148.033606:0:6680:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1789265148.033620:0:6680:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1789265148.078602:0:6680:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789265148.078887:0:6680:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1789265148.078894:0:6680:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1789265148.082181:0:6680:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1789265148.082196:0:6680:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1789265148.082741:0:6680:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1789265148.082841:0:6680:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1789265148.082847:0:6680:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.137@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1789265148.116377:0:6680:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.137@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789265148.116425:0:6680:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.137@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1789265148.116598:0:6680:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789265148.116600:0:6680:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789265148.116601:0:6680:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789265148.116603:0:6680:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789265148.116604:0:6680:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789265148.116605:0:6680:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789265148.116607:0:6680:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789265148.116608:0:6680:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789265148.116609:0:6680:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789265148.116611:0:6680:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789265148.116612:0:6680:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789265148.116616:0:6680:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1789265148.116619:0:6680:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789265148.116620:0:6680:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789265148.116621:0:6680:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789265148.116628:0:6680:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789265148.116629:0:6680:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789265148.116630:0:6680:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789265148.116631:0:6680:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789265148.116632:0:6680:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789265148.116633:0:6680:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789265148.116633:0:6680:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789265148.116634:0:6680:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789265148.116666:0:6680:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789265148.116686:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:6680:1876180414239488:0@lo:253: 00000100:00100000:1.0:1789265148.116807:0:6680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265148.116944:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414239488 00000100:00100000:0.0:1789265148.116953:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414239488 00000100:00100000:0.0:1789265148.117001:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789265148.117010:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+12:6680:x1876180414239488:12345-0@lo:253: 20000000:01000000:0.0:1789265148.117039:0:5834:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789265148.117044:0:5834:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1789265148.117050:0:5834:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1789265148.117053:0:5834:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000100:00100000:1.0:1789265148.117881:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103ba1a6c0 going to sleep for 11 seconds 00000040:00080000:0.0:1789265148.118421:0:5834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789265148.120050:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1789265148.120096:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1789265148.120165:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1789265148.120175:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1789265148.120206:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1789265148.120257:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1789265148.120685:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1789265148.120705:0:5834:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.137@tcp 20000000:01000000:0.0:1789265148.120707:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.137@tcp (null) (null) (null) 00000040:00080000:0.0:1789265148.120740:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1789265148.120760:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789265148.120811:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1789265148.120819:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.137@tcp (null) (null) 00000040:00080000:0.0:1789265148.120849:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1789265148.120858:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1789265148.120886:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1789265148.120930:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:3.0:1789265148.122783:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1789265148.122809:0:5834:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.137@tcp 20000000:01000000:3.0:1789265148.122812:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.137@tcp (null) (null) (null) 00000040:00080000:3.0:1789265148.122848:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1789265148.122856:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1789265148.122889:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1789265148.122896:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.137@tcp (null) (null) 00000040:00080000:3.0:1789265148.122949:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1789265148.122968:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789265148.123003:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1789265148.123039:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1789265148.123053:0:5834:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:3.0:1789265148.123056:0:5834:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:3.0:1789265148.123061:0:5834:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789265148.123063:0:5834:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789265148.123065:0:5834:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789265148.123108:0:5834:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789265148.123111:0:5834:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1789265148.123142:0:5834:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789265148.123145:0:5834:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789265148.123781:0:6695:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:3.0:1789265148.123829:0:6695:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:3.0:1789265148.123891:0:6695:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1789265148.124258:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:1.0:1789265148.124298:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:1.0:1789265148.124331:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:1.0:1789265148.124342:0:5834:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789265148.124344:0:5834:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789265148.127419:0:6696:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1789265148.127580:0:6696:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1789265148.127640:0:6696:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1789265148.128020:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1789265148.128060:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1789265148.128350:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1789265148.128365:0:5834:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789265148.128367:0:5834:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789265148.128805:0:6697:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1789265148.129016:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:1.0:1789265148.129055:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:1.0:1789265148.129237:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 10000000:01000000:1.0:1789265148.129256:0:5834:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789265148.129274:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a101b596e00/0x27274ba5bb951c87 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265148.129292:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a101b596400/0x27274ba5bb951ba0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb951b99 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265148.129299:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a101b596a00/0x27274ba5bb951bbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb951bb5 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265148.129319:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a10421eaa00/0x27274ba5bb951c2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb951c25 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265148.129327:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a101b596e00/0x27274ba5bb951c87 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265148.129364:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a10421eaa00/0x27274ba5bb951c2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27274ba5bb951c25 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265148.129380:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a10421eaa00/0x27274ba5bb951c2c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27274ba5bb951c25 expref: 12 pid: 5833 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265148.129394:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d4e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5834:1876180414239616:0@lo:104: 00000100:00100000:1.0:1789265148.129533:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789265148.129628:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a101b596a00/0x27274ba5bb951bbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27274ba5bb951bb5 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265148.129638:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a101b596a00/0x27274ba5bb951bbc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27274ba5bb951bb5 expref: 12 pid: 5835 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265148.129646:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d4700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5834:1876180414239744:0@lo:104: 00000100:00100000:1.0:1789265148.129669:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789265148.129842:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a101b596400/0x27274ba5bb951ba0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27274ba5bb951b99 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265148.129850:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a101b596400/0x27274ba5bb951ba0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27274ba5bb951b99 expref: 12 pid: 5834 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265148.129858:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d1f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5834:1876180414239872:0@lo:104: 00000100:00100000:2.0:1789265148.129881:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265148.129953:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414239616 00000100:00100000:3.0:1789265148.129959:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414239616 00000100:00100000:3.0:1789265148.129993:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414239744 00000100:00100000:3.0:1789265148.129996:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414239744 00000100:00100000:3.0:1789265148.130010:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789265148.130017:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c0d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:871daf34-1206-40e7-bd71-78303abe4d37+4:5834:x1876180414239616:12345-0@lo:104: 00010000:00010000:3.0:1789265148.130029:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff8a1017262a00/0x27274ba5bb951c25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x27274ba5bb951c2c expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265148.130107:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789265148.130114:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c0d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:871daf34-1206-40e7-bd71-78303abe4d37+4:5834:x1876180414239616:12345-0@lo:104: Request processed in 97us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265148.130120:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789265148.130147:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789265148.130165:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c0d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:871daf34-1206-40e7-bd71-78303abe4d37+3:5834:x1876180414239744:12345-0@lo:104: 00010000:00010000:3.0:1789265148.130173:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff8a10421eb600/0x27274ba5bb951bb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x27274ba5bb951bbc expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265148.130207:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789265148.130212:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c0d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:871daf34-1206-40e7-bd71-78303abe4d37+3:5834:x1876180414239744:12345-0@lo:104: Request processed in 49us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265148.130218:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1789265148.130271:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789265148.130278:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff8a1017262a00/0x27274ba5bb951c25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x27274ba5bb951c2c expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265148.130286:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1017262a00 already unused, calling callback (ffffffffc1ba2c20) 10000000:00010000:1.0:1789265148.130290:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff8a1017262a00/0x27274ba5bb951c25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x27274ba5bb951c2c expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265148.130306:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff8a1017262a00/0x27274ba5bb951c25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x27274ba5bb951c2c expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265148.130313:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff8a1017262a00/0x27274ba5bb951c25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x27274ba5bb951c2c expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265148.130319:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789265148.130355:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff8a1017262a00/0x27274ba5bb951c25 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951c2c expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265148.130361:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789265148.130385:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff8a1017262a00/0x27274ba5bb951c25 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951c2c expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265148.130392:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff8a1017262a00/0x27274ba5bb951c25 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951c2c expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265148.130405:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265148.130408:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff8a10421eb600/0x27274ba5bb951bb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x27274ba5bb951bbc expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265148.130413:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a10421eb600 already unused, calling callback (ffffffffc1ba2c20) 10000000:00010000:1.0:1789265148.130416:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff8a10421eb600/0x27274ba5bb951bb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x27274ba5bb951bbc expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265148.130421:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff8a10421eb600/0x27274ba5bb951bb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x27274ba5bb951bbc expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265148.130538:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff8a10421eb600/0x27274ba5bb951bb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x27274ba5bb951bbc expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265148.130551:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789265148.130576:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff8a10421eb600/0x27274ba5bb951bb5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951bbc expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265148.130582:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789265148.130588:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff8a10421eb600/0x27274ba5bb951bb5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951bbc expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265148.130594:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff8a10421eb600/0x27274ba5bb951bb5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951bbc expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265148.130613:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265148.130615:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265148.130616:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265148.130628:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:871daf34-1206-40e7-bd71-78303abe4d37:3317:1876180414240000:0@lo:103: 00000100:00100000:1.0:1789265148.130656:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265148.130685:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789265148.130691:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:871daf34-1206-40e7-bd71-78303abe4d37:3317:1876180414240128:0@lo:103: 00000100:00100000:1.0:1789265148.130709:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265148.130733:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414240000 00000100:00100000:1.0:1789265148.130737:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414240000 00010000:00010000:1.0:1789265148.130755:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a10421eaa00/0x27274ba5bb951c2c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27274ba5bb951c25 expref: 13 pid: 5833 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265148.130771:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414240128 00000100:00100000:1.0:1789265148.130774:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414240128 00010000:00010000:1.0:1789265148.130784:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a101b596a00/0x27274ba5bb951bbc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27274ba5bb951bb5 expref: 14 pid: 5835 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265148.130810:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789265148.130816:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c0d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:871daf34-1206-40e7-bd71-78303abe4d37+14:3317:x1876180414240000:12345-0@lo:103: 00010000:00010000:1.0:1789265148.130826:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265148.130831:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a10421eaa00/0x27274ba5bb951c2c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27274ba5bb951c25 expref: 14 pid: 5833 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265148.130841:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a10421eaa00/0x27274ba5bb951c2c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27274ba5bb951c25 expref: 14 pid: 5833 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265148.130857:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265148.130885:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c0d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:871daf34-1206-40e7-bd71-78303abe4d37+14:3317:x1876180414240000:12345-0@lo:103: Request processed in 70us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265148.130892:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789265148.130904:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789265148.130910:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c0d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:871daf34-1206-40e7-bd71-78303abe4d37+13:3317:x1876180414240128:12345-0@lo:103: 00010000:00010000:1.0:1789265148.130917:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265148.130920:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a101b596a00/0x27274ba5bb951bbc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27274ba5bb951bb5 expref: 13 pid: 5835 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265148.130929:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a101b596a00/0x27274ba5bb951bbc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27274ba5bb951bb5 expref: 13 pid: 5835 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265148.130938:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265148.130958:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c0d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:871daf34-1206-40e7-bd71-78303abe4d37+13:3317:x1876180414240128:12345-0@lo:103: Request processed in 48us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265148.130963:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789265148.130993:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:871daf34-1206-40e7-bd71-78303abe4d37:3317:1876180414240128:0@lo:103: 00000100:00100000:1.0:1789265148.131012:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:871daf34-1206-40e7-bd71-78303abe4d37:3317:1876180414240000:0@lo:103: 00010000:00010000:1.0:1789265148.131145:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265148.131298:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103ba1af00 going to sleep for 11 seconds 00010000:00010000:2.0:1789265148.131313:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a10421eaa00/0x27274ba5bb951c2c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27274ba5bb951c25 expref: 12 pid: 5833 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265148.131325:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d4e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5834:1876180414239616:0@lo:104: 00010000:00010000:2.0:1789265148.131334:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a101b596a00/0x27274ba5bb951bbc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27274ba5bb951bb5 expref: 11 pid: 5835 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265148.131344:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d4700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5834:1876180414239744:0@lo:104: 00000100:00100000:3.0:1789265148.131409:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414239872 00000100:00100000:3.0:1789265148.131414:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414239872 00000100:00100000:3.0:1789265148.131446:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789265148.131453:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c0d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:871daf34-1206-40e7-bd71-78303abe4d37+3:5834:x1876180414239872:12345-0@lo:104: 00010000:00010000:3.0:1789265148.131463:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff8a1017263600/0x27274ba5bb951b99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27274ba5bb951ba0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265148.131565:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d1f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5834:1876180414239872:0@lo:104: 00010000:00010000:2.0:1789265148.131586:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a101b596e00/0x27274ba5bb951c87 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265148.131684:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789265148.131691:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c0d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:871daf34-1206-40e7-bd71-78303abe4d37+3:5834:x1876180414239872:12345-0@lo:104: Request processed in 238us (1808us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265148.131697:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1789265148.131798:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265148.131804:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff8a1017263600/0x27274ba5bb951b99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27274ba5bb951ba0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265148.131811:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1017263600 already unused, calling callback (ffffffffc1ba2c20) 10000000:00010000:1.0:1789265148.131814:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff8a1017263600/0x27274ba5bb951b99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x27274ba5bb951ba0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265148.131821:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff8a1017263600/0x27274ba5bb951b99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x27274ba5bb951ba0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265148.131827:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff8a1017263600/0x27274ba5bb951b99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x27274ba5bb951ba0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265148.131832:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789265148.131860:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff8a1017263600/0x27274ba5bb951b99 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951ba0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265148.131865:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789265148.131883:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff8a1017263600/0x27274ba5bb951b99 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951ba0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265148.131890:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff8a1017263600/0x27274ba5bb951b99 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951ba0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265148.131905:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265148.131907:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265148.131908:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265148.131982:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:871daf34-1206-40e7-bd71-78303abe4d37:3315:1876180414240256:0@lo:103: 00000100:00100000:0.0:1789265148.132016:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265148.132208:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414240256 00000100:00100000:1.0:1789265148.132213:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414240256 00010000:00010000:1.0:1789265148.132232:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a101b596400/0x27274ba5bb951ba0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27274ba5bb951b99 expref: 11 pid: 5834 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265148.132306:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789265148.132314:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c07a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:871daf34-1206-40e7-bd71-78303abe4d37+11:3315:x1876180414240256:12345-0@lo:103: 00010000:00010000:1.0:1789265148.132323:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265148.132327:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a101b596400/0x27274ba5bb951ba0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27274ba5bb951b99 expref: 11 pid: 5834 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265148.132337:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a101b596400/0x27274ba5bb951ba0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27274ba5bb951b99 expref: 11 pid: 5834 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265148.132349:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a101b596400/0x27274ba5bb951ba0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27274ba5bb951b99 expref: 11 pid: 5834 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265148.132362:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a101b596e00/0x27274ba5bb951c87 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265148.132369:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a101b596e00/0x27274ba5bb951c87 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265148.132383:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a101b596e00/0x27274ba5bb951c87 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265148.132390:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a101b596e00/0x27274ba5bb951c87 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265148.132396:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a101b596e00/0x27274ba5bb951c87 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265148.132414:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a101b596e00/0x27274ba5bb951c87 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265148.132419:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b596e00 already unused, calling callback (ffffffffc1581350) 00010000:00010000:1.0:1789265148.132423:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a101b596e00/0x27274ba5bb951c87 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265148.132441:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a101b596e00/0x27274ba5bb951c87 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265148.132462:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a101b596e00/0x27274ba5bb951c87 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265148.132473:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265148.132502:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c07a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:871daf34-1206-40e7-bd71-78303abe4d37+10:3315:x1876180414240256:12345-0@lo:103: Request processed in 190us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265148.132509:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789265148.132566:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:871daf34-1206-40e7-bd71-78303abe4d37:3315:1876180414240256:0@lo:103: 00010000:00010000:0.0:1789265148.132586:0:5834:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a101b596e00/0x27274ba5bb951c87 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265148.132594:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a101b596e00/0x27274ba5bb951c87 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265148.132600:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a101b596e00/0x27274ba5bb951c87 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789265148.132614:0:5834:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1789265148.170600:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+9:6680:x1876180414239488:12345-0@lo:253: Request processed in 53573us (53775us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265148.170614:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789265148.170744:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:6680:1876180414239488:0@lo:253: 10000000:01000000:1.0:1789265148.170760:0:6680:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789265148.170763:0:6680:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789265148.170765:0:6680:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789265148.170766:0:6680:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789265148.170767:0:6680:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1789265148.170768:0:6680:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789265148.170770:0:6680:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789265148.170771:0:6680:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789265148.170773:0:6680:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1789265148.170775:0:6680:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789265148.170776:0:6680:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789265148.170796:0:6680:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a103c151000 from lustre-OST0000 10000000:01000000:1.0:1789265148.170821:0:6680:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1789265148.170835:0:6680:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789265148.170841:0:6680:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8a10087899b8 local copy 10000000:01000000:1.0:1789265148.170844:0:6680:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789265148.170881:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a101b596400/0x27274ba5bb951c8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265148.170893:0:6680:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.137@tcp lock: ffff8a101b596400/0x27274ba5bb951c8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265148.170903:0:6680:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff8a101b596400/0x27274ba5bb951c8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265148.170920:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:6680:1876180414240384:0@lo:101: 00000100:00100000:1.0:1789265148.170955:0:6680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265148.171048:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103ba1a840 going to sleep for 11 seconds 00000100:00100000:0.0:1789265148.171215:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414240384 00000100:00100000:0.0:1789265148.171221:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414240384 00000100:00100000:1.0:1789265148.171369:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789265148.171379:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+9:6680:x1876180414240384:12345-0@lo:101: 00010000:00010000:1.0:1789265148.171392:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265148.171406:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a101b597e00/0x27274ba5bb951c95 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27274ba5bb951c8e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265148.171428:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a101b597e00/0x27274ba5bb951c95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27274ba5bb951c8e expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265148.171438:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a101b597e00/0x27274ba5bb951c95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb951c8e expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265148.171467:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a101b597e00, rc 0) 00000100:00100000:1.0:1789265148.171506:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+10:6680:x1876180414240384:12345-0@lo:101: Request processed in 129us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265148.171522:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789265148.171596:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:6680:1876180414240384:0@lo:101: 00010000:00010000:3.0:1789265148.171609:0:6680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff8a101b596400/0x27274ba5bb951c8e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x27274ba5bb951c95 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265148.171619:0:6680:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff8a101b596400/0x27274ba5bb951c8e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x27274ba5bb951c95 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265148.171715:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10088e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:6680:1876180414240512:0@lo:501: 00000100:00100000:3.0:1789265148.171751:0:6680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265148.171993:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a100914ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1789265148.172095:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414240512 00000100:00100000:2.0:1789265148.172101:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414240512 00000100:00100000:2.0:1789265148.172125:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789265148.172131:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+10:6680:x1876180414240512:12345-0@lo:501: 00000100:00100000:2.0:1789265148.172346:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+10:6680:x1876180414240512:12345-0@lo:501: Request processed in 214us (594us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789265148.172359:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789265148.172439:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10088e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:6680:1876180414240512:0@lo:501: 10000000:01000000:3.0:1789265148.172453:0:6680:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.137@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789265148.172479:0:6680:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.137@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789265148.172484:0:6680:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a101b596400/0x27274ba5bb951c8e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x27274ba5bb951c95 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265148.172493:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a101b596400/0x27274ba5bb951c8e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x27274ba5bb951c95 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265148.172500:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.137@tcp lock: ffff8a101b596400/0x27274ba5bb951c8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x27274ba5bb951c95 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265148.172525:0:6680:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789265148.172543:0:6680:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8a103c151000 10000000:01000000:3.0:1789265148.172548:0:6680:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789265148.172553:0:6680:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8a10087899b8 10000000:01000000:3.0:1789265148.172555:0:6680:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1789265148.172559:0:6680:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a10087899b8 from 1 10000000:01000000:3.0:1789265148.172562:0:6680:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789265148.172591:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a10421ebe00/0x27274ba5bb951c9c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265148.172600:0:6680:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff8a10421ebe00/0x27274ba5bb951c9c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265148.172608:0:6680:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff8a10421ebe00/0x27274ba5bb951c9c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265148.172629:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10088e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:6680:1876180414240640:0@lo:101: 00000100:00100000:3.0:1789265148.172654:0:6680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265148.172671:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a100914a900 going to sleep for 11 seconds 00010000:00010000:2.0:1789265148.172771:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265148.172777:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff8a101b596400/0x27274ba5bb951c8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x27274ba5bb951c95 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265148.172784:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b596400 already unused, calling callback (ffffffffc1ba2c20) 10000000:00010000:2.0:1789265148.172787:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff8a101b596400/0x27274ba5bb951c8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x27274ba5bb951c95 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265148.172795:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff8a101b596400/0x27274ba5bb951c8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x27274ba5bb951c95 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265148.172802:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff8a101b596400/0x27274ba5bb951c8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x27274ba5bb951c95 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265148.172808:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789265148.172825:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff8a101b596400/0x27274ba5bb951c8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x27274ba5bb951c95 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265148.172831:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265148.172853:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff8a101b596400/0x27274ba5bb951c8e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x27274ba5bb951c95 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265148.172859:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff8a101b596400/0x27274ba5bb951c8e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x27274ba5bb951c95 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265148.172872:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265148.172874:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265148.172875:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265148.172884:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414240640 00000100:00100000:2.0:1789265148.172894:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414240640 00000100:00100000:2.0:1789265148.172916:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789265148.172922:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+10:6680:x1876180414240640:12345-0@lo:101: 00010000:00010000:2.0:1789265148.172929:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265148.172940:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1042044800/0x27274ba5bb951ca3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27274ba5bb951c9c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265148.172955:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1042044800/0x27274ba5bb951ca3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27274ba5bb951c9c expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265148.172963:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1042044800/0x27274ba5bb951ca3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb951c9c expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265148.172970:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1042044800, rc 0) 00000100:00100000:2.0:1789265148.173007:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+11:6680:x1876180414240640:12345-0@lo:101: Request processed in 85us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265148.173014:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789265148.173179:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10088e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:6680:1876180414240640:0@lo:101: 00010000:00010000:3.0:1789265148.173191:0:6680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff8a10421ebe00/0x27274ba5bb951c9c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951ca3 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265148.173198:0:6680:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff8a10421ebe00/0x27274ba5bb951c9c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27274ba5bb951ca3 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265148.173213:0:6680:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789265148.173230:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a10421ebe00/0x27274ba5bb951c9c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951ca3 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265148.173237:0:6680:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff8a10421ebe00/0x27274ba5bb951c9c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951ca3 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265148.173243:0:6680:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789265148.173247:0:6680:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789265148.173252:0:6680:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1789265148.173254:0:6680:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789265148.173268:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a10421ea400/0x27274ba5bb951caa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265148.173275:0:6680:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff8a10421ea400/0x27274ba5bb951caa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265148.173282:0:6680:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff8a10421ea400/0x27274ba5bb951caa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265148.173301:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10088e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:6680:1876180414240896:0@lo:101: 00000100:00100000:3.0:1789265148.173327:0:6680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265148.173344:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a100914a900 going to sleep for 11 seconds 00000100:00100000:2.0:1789265148.173397:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414240896 00000100:00100000:2.0:1789265148.173402:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414240896 00000100:00100000:2.0:1789265148.173420:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789265148.173426:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+11:6680:x1876180414240896:12345-0@lo:101: 00010000:00010000:2.0:1789265148.173433:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265148.173441:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1042045a00/0x27274ba5bb951cb1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x27274ba5bb951caa expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265148.173454:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1042045a00/0x27274ba5bb951cb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27274ba5bb951caa expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265148.173462:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1042045a00/0x27274ba5bb951cb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb951caa expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265148.173479:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1042045a00, rc 0) 00000100:00100000:2.0:1789265148.173512:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+12:6680:x1876180414240896:12345-0@lo:101: Request processed in 86us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265148.173519:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789265148.173581:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10088e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:6680:1876180414240896:0@lo:101: 00010000:00010000:3.0:1789265148.173661:0:6680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff8a10421ea400/0x27274ba5bb951caa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951cb1 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265148.173669:0:6680:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff8a10421ea400/0x27274ba5bb951caa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27274ba5bb951cb1 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265148.173743:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10088e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:6680:1876180414241024:0@lo:501: 00000100:00100000:3.0:1789265148.173771:0:6680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265148.173824:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a100914a900 going to sleep for 11 seconds 00000100:00100000:1.0:1789265148.173947:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414241024 00000100:00100000:1.0:1789265148.173952:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414241024 00000100:00100000:2.0:1789265148.173987:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789265148.173994:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+12:6680:x1876180414241024:12345-0@lo:501: 00000100:00100000:2.0:1789265148.174221:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+12:6680:x1876180414241024:12345-0@lo:501: Request processed in 227us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265148.174228:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789265148.174299:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10088e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:6680:1876180414241024:0@lo:501: 00000100:00100000:3.0:1789265148.174324:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10088e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:6680:1876180414241152:0@lo:503: 00000100:00100000:3.0:1789265148.174359:0:6680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265148.174389:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a100914a900 going to sleep for 11 seconds 00000100:00100000:2.0:1789265148.174432:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414241152 00000100:00100000:2.0:1789265148.174436:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414241152 00000100:00100000:2.0:1789265148.174454:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789265148.174459:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+12:6680:x1876180414241152:12345-0@lo:503: 00000100:00100000:2.0:1789265148.174602:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+12:6680:x1876180414241152:12345-0@lo:503: Request processed in 142us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265148.174609:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789265148.174729:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10088e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:6680:1876180414241152:0@lo:503: 00000040:00080000:3.0:1789265148.175006:0:6680:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789265148.175066:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10088e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:6680:1876180414241280:0@lo:502: 00000100:00100000:3.0:1789265148.175135:0:6680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265148.175163:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a100914a900 going to sleep for 11 seconds 00000100:00100000:2.0:1789265148.175229:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414241280 00000100:00100000:2.0:1789265148.175233:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414241280 00000100:00100000:2.0:1789265148.175253:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789265148.175259:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+12:6680:x1876180414241280:12345-0@lo:502: 00000100:00100000:2.0:1789265148.175381:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+12:6680:x1876180414241280:12345-0@lo:502: Request processed in 122us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265148.175388:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789265148.175465:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10088e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:6680:1876180414241280:0@lo:502: 00000040:00080000:3.0:1789265148.175701:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789265148.175756:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1789265148.175789:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1789265148.175836:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1789265148.175875:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1789265148.175909:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1789265148.175932:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10088e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:6680:1876180414241408:0@lo:502: 00000100:00100000:3.0:1789265148.175967:0:6680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265148.175997:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a100914a900 going to sleep for 11 seconds 00000100:00100000:2.0:1789265148.176138:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414241408 00000100:00100000:2.0:1789265148.176143:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414241408 00000100:00100000:0.0:1789265148.176879:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:871daf34-1206-40e7-bd71-78303abe4d37:3316:1876180414240768:0@lo:103: 00000100:00100000:0.0:1789265148.176926:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265148.177039:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414240768 00000100:00100000:3.0:1789265148.177044:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414240768 00000100:00100000:3.0:1789265148.177112:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789265148.177121:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c078e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:871daf34-1206-40e7-bd71-78303abe4d37+12:3316:x1876180414240768:12345-0@lo:103: 00010000:00010000:3.0:1789265148.177134:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265148.177164:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a101b597e00/0x27274ba5bb951c95 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x27274ba5bb951c8e expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265148.177179:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265148.177212:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c078e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:871daf34-1206-40e7-bd71-78303abe4d37+11:3316:x1876180414240768:12345-0@lo:103: Request processed in 93us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265148.177218:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789265148.177290:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:871daf34-1206-40e7-bd71-78303abe4d37:3316:1876180414240768:0@lo:103: 00000100:00100000:0.0:1789265148.177528:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789265148.177537:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+11:6680:x1876180414241408:12345-0@lo:502: 00000100:00100000:0.0:1789265148.177738:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+11:6680:x1876180414241408:12345-0@lo:502: Request processed in 202us (1770us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265148.177745:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789265148.177873:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10088e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:6680:1876180414241408:0@lo:502: 00000040:00080000:3.0:1789265148.177991:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1789265148.178005:0:6680:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:1.0:1789265148.178649:0:6699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789265148.178657:0:6699:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1789265148.178664:0:6699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265148.178666:0:6699:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1789265148.178672:0:6699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789265148.178687:0:6699:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8a10037d0000) 00000020:00000080:1.0:1789265148.178707:0:6699:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789265148.178713:0:6699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789265148.178781:0:6699:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a103c151000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1789265148.178788:0:6699:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789265148.178797:0:6699:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x27274ba5bb951cbf 00010000:00010000:1.0:1789265148.183423:0:6699:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:1.0:1789265148.183917:0:6699:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1789265148.186768:0:6699:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1789265148.187036:0:6699:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1789265148.193436:0:6699:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1789265148.194005:0:6699:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1789265148.195687:0:6699:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1789265148.195700:0:6699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265148.195707:0:6699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265148.195709:0:6699:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1789265148.195713:0:6699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265148.195717:0:6699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265148.195718:0:6699:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789265148.195728:0:6699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789265148.195730:0:6699:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789265148.195777:0:6699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265148.195781:0:6699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265148.195782:0:6699:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789265148.195785:0:6699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1789265148.195916:0:6680:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1789265148.195939:0:6680:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789265148.195962:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a10421ea400/0x27274ba5bb951caa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951cb1 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265148.195973:0:6680:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff8a10421ea400/0x27274ba5bb951caa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951cb1 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265148.195982:0:6680:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a103c151000 from 1 10000000:01000000:1.0:1789265148.195985:0:6680:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789265148.196024:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a101b597e00/0x27274ba5bb951cc6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265148.196033:0:6680:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff8a101b597e00/0x27274ba5bb951cc6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265148.196044:0:6680:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff8a101b597e00/0x27274ba5bb951cc6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265148.196065:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:6680:1876180414241536:0@lo:101: 00000100:00100000:1.0:1789265148.196174:0:6680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265148.196314:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103ba1a300 going to sleep for 11 seconds 00000100:00100000:0.0:1789265148.197306:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414241536 00000100:00100000:0.0:1789265148.197316:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414241536 00000100:00100000:0.0:1789265148.197363:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789265148.197373:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+11:6680:x1876180414241536:12345-0@lo:101: 00010000:00010000:0.0:1789265148.197388:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265148.197403:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1017263200/0x27274ba5bb951ccd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x27274ba5bb951cc6 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265148.197427:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1017263200/0x27274ba5bb951ccd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27274ba5bb951cc6 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265148.197438:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1017263200/0x27274ba5bb951ccd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb951cc6 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265148.197447:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1017263200, rc 0) 00000100:00100000:0.0:1789265148.197511:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+12:6680:x1876180414241536:12345-0@lo:101: Request processed in 139us (1336us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265148.197518:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789265148.197713:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:6680:1876180414241536:0@lo:101: 00010000:00010000:1.0:1789265148.197731:0:6680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff8a101b597e00/0x27274ba5bb951cc6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951ccd expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265148.197741:0:6680:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff8a101b597e00/0x27274ba5bb951cc6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x27274ba5bb951ccd expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265148.197838:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:6680:1876180414241664:0@lo:501: 00000100:00100000:1.0:1789265148.197872:0:6680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265148.197906:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103ba1a300 going to sleep for 11 seconds 00000100:00100000:2.0:1789265148.197954:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414241664 00000100:00100000:2.0:1789265148.197958:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414241664 00000100:00100000:2.0:1789265148.197990:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789265148.197998:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+12:6680:x1876180414241664:12345-0@lo:501: 00000100:00100000:2.0:1789265148.198244:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+12:6680:x1876180414241664:12345-0@lo:501: Request processed in 246us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265148.198251:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789265148.198340:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:6680:1876180414241664:0@lo:501: 00000100:00100000:1.0:1789265148.198367:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:6680:1876180414241792:0@lo:503: 00000100:00100000:1.0:1789265148.198402:0:6680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265148.198430:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103ba1a300 going to sleep for 11 seconds 00000100:00100000:2.0:1789265148.198475:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414241792 00000100:00100000:2.0:1789265148.198480:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414241792 00000100:00100000:2.0:1789265148.198502:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789265148.198508:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+12:6680:x1876180414241792:12345-0@lo:503: 00000100:00100000:2.0:1789265148.198912:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+12:6680:x1876180414241792:12345-0@lo:503: Request processed in 402us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265148.198920:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789265148.203735:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:6680:1876180414241792:0@lo:503: 00000040:00080000:1.0:1789265148.204110:0:6680:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789265148.204215:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:6680:1876180414241920:0@lo:502: 00000100:00100000:1.0:1789265148.204282:0:6680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265148.204383:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103ba1a300 going to sleep for 11 seconds 00000100:00100000:0.0:1789265148.205522:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414241920 00000100:00100000:0.0:1789265148.205532:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414241920 00000100:00100000:1.0:1789265148.205700:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789265148.205709:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+12:6680:x1876180414241920:12345-0@lo:502: 00000100:00100000:1.0:1789265148.205964:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+12:6680:x1876180414241920:12345-0@lo:502: Request processed in 255us (1681us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265148.205972:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789265148.206095:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:6680:1876180414241920:0@lo:502: 00000040:00080000:0.0:1789265148.206382:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1789265148.206436:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1789265148.206469:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c078000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:6680:1876180414242048:0@lo:502: 00000100:00100000:0.0:1789265148.206511:0:6680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265148.206537:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103ba1a300 going to sleep for 11 seconds 00000100:00100000:2.0:1789265148.206674:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414242048 00000100:00100000:2.0:1789265148.206680:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414242048 00000100:00100000:2.0:1789265148.206716:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789265148.206726:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+12:6680:x1876180414242048:12345-0@lo:502: 00000100:00100000:2.0:1789265148.206867:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+12:6680:x1876180414242048:12345-0@lo:502: Request processed in 143us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265148.206875:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789265148.206962:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c078000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:6680:1876180414242048:0@lo:502: 00000040:00080000:0.0:1789265148.207040:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1789265148.207050:0:6680:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1789265148.207568:0:6703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789265148.207577:0:6703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265148.207580:0:6703:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789265148.207655:0:6703:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a103c151000 00000020:00000080:0.0:1789265148.207658:0:6703:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789265148.207682:0:6703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789265148.207685:0:6703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265148.207686:0:6703:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1789265148.207689:0:6703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1789265148.207799:0:6680:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789265148.207816:0:6680:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789265148.207837:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a101b597e00/0x27274ba5bb951cc6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951ccd expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265148.207849:0:6680:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff8a101b597e00/0x27274ba5bb951cc6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951ccd expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265148.207881:0:6680:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789265148.207883:0:6680:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8a103c151000 10000000:01000000:1.0:1789265148.207886:0:6680:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8a103c151000 10000000:01000000:1.0:1789265148.207889:0:6680:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789265148.207894:0:6680:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a103c151000 from 1 10000000:01000000:1.0:1789265148.207897:0:6680:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789265148.207924:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a101b596400/0x27274ba5bb951cd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265148.207934:0:6680:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff8a101b596400/0x27274ba5bb951cd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265148.207943:0:6680:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff8a101b596400/0x27274ba5bb951cd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265148.207966:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:6680:1876180414242176:0@lo:101: 00000100:00100000:1.0:1789265148.208006:0:6680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265148.208041:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10086f23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265148.208157:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414242176 00000100:00100000:0.0:1789265148.208163:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414242176 00000100:00100000:0.0:1789265148.208195:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789265148.208203:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+12:6680:x1876180414242176:12345-0@lo:101: 00010000:00010000:0.0:1789265148.208212:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265148.208224:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1017262200/0x27274ba5bb951cdb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x27274ba5bb951cd4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265148.208249:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1017262200/0x27274ba5bb951cdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27274ba5bb951cd4 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265148.208260:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1017262200/0x27274ba5bb951cdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb951cd4 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265148.208268:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1017262200, rc 0) 00000100:00100000:0.0:1789265148.208297:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+13:6680:x1876180414242176:12345-0@lo:101: Request processed in 94us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265148.208303:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789265148.208387:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:6680:1876180414242176:0@lo:101: 00010000:00010000:1.0:1789265148.208398:0:6680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff8a101b596400/0x27274ba5bb951cd4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951cdb expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265148.208408:0:6680:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff8a101b596400/0x27274ba5bb951cd4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x27274ba5bb951cdb expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265148.208477:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:6680:1876180414242304:0@lo:501: 00000100:00100000:1.0:1789265148.208499:0:6680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265148.208523:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10086f23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265148.208561:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414242304 00000100:00100000:0.0:1789265148.208565:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414242304 00000100:00100000:0.0:1789265148.208667:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789265148.208674:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+13:6680:x1876180414242304:12345-0@lo:501: 00000100:00100000:0.0:1789265148.208853:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+13:6680:x1876180414242304:12345-0@lo:501: Request processed in 179us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265148.208859:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789265148.208964:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:6680:1876180414242304:0@lo:501: 00000100:00100000:1.0:1789265148.208986:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:6680:1876180414242432:0@lo:503: 00000100:00100000:1.0:1789265148.209016:0:6680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265148.209178:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10086f23c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265148.209308:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414242432 00000100:00100000:2.0:1789265148.209312:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414242432 00000100:00100000:2.0:1789265148.209332:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789265148.209338:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+13:6680:x1876180414242432:12345-0@lo:503: 00000100:00100000:2.0:1789265148.209478:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+13:6680:x1876180414242432:12345-0@lo:503: Request processed in 138us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265148.209493:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789265148.209563:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:6680:1876180414242432:0@lo:503: 00000040:00080000:1.0:1789265148.209816:0:6680:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789265148.209868:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:6680:1876180414242560:0@lo:502: 00000100:00100000:1.0:1789265148.209896:0:6680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265148.209925:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10086f23c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265148.210014:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414242560 00000100:00100000:2.0:1789265148.210018:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414242560 00000100:00100000:2.0:1789265148.210035:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789265148.210040:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+13:6680:x1876180414242560:12345-0@lo:502: 00000100:00100000:2.0:1789265148.210218:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+13:6680:x1876180414242560:12345-0@lo:502: Request processed in 177us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265148.210225:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789265148.210353:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:6680:1876180414242560:0@lo:502: 00000040:00080000:1.0:1789265148.210644:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1789265148.210703:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1789265148.210737:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1789265148.210782:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1789265148.210818:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1789265148.210877:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1789265148.210918:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1789265148.210951:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1789265148.210999:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1789265148.211033:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1789265148.211065:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1789265148.211412:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1789265148.211454:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1789265148.211504:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1789265148.211554:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1789265148.211740:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1789265148.211782:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1789265148.211830:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1789265148.211867:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1789265148.211901:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1789265148.211959:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1789265148.212000:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1789265148.212036:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1789265148.212191:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1789265148.212233:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1789265148.212269:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1789265148.212319:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1789265148.212356:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:1.0:1789265148.212404:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:6680:1876180414242688:0@lo:502: 00000100:00100000:1.0:1789265148.212476:0:6680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265148.212553:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10086f23c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265148.212732:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414242688 00000100:00100000:3.0:1789265148.212740:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414242688 00000100:00100000:2.0:1789265148.212798:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789265148.212809:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+13:6680:x1876180414242688:12345-0@lo:502: 00000100:00100000:2.0:1789265148.213015:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+13:6680:x1876180414242688:12345-0@lo:502: Request processed in 207us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265148.213022:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789265148.213160:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:6680:1876180414242688:0@lo:502: 00000040:00080000:1.0:1789265148.213236:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1789265148.213254:0:6680:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1789265148.213930:0:6704:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789265148.213955:0:6704:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8a1037ecb370) 00000020:00000080:0.0:1789265148.213975:0:6704:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1789265148.214110:0:6704:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a103c151000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789265148.214115:0:6704:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a103c151000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789265148.214117:0:6704:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a103c151000 3 00010000:00080000:0.0:1789265148.214145:0:6704:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a1037ed0000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.137@tcp at head 00010000:00010000:1.0:1789265148.215744:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265148.216242:0:6704:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:0.0:1789265148.216424:0:6704:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1789265148.216458:0:6704:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789265148.216541:0:6704:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x27274ba5bb951ce9 00000100:00080000:0.0:1789265148.216551:0:6704:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789265148.216556:0:6704:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a1037ed0000 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:0.0:1789265148.216658:0:6704:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a103c078000 x1876180414242816/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789265148.216675:0:6704:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789265148.216895:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c078000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3314:1876180414242816:0@lo:38: 00000100:00100000:1.0:1789265148.216966:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265148.217067:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789265148.217095:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876180414242944:0@lo:400: 00000100:00100000:1.0:1789265148.217120:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265148.217161:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414242816 00000100:00100000:1.0:1789265148.217167:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414242816 00000100:00100000:1.0:1789265148.217191:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414242944 00000100:00100000:1.0:1789265148.217194:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414242944 00000100:00100000:1.0:1789265148.217218:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789265148.217227:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c0d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876180414242944:12345-0@lo:400: 00000100:00100000:1.0:1789265148.217277:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c0d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876180414242944:12345-0@lo:400: Request processed in 51us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265148.217284:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789265148.217298:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789265148.217302:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c0d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3314:x1876180414242816:12345-0@lo:38: 00010000:00080000:1.0:1789265148.217334:0:5841:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 194 last 0 00000020:00000080:1.0:1789265148.217360:0:5841:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x27274ba5bb951cf0 00000004:00100000:1.0:1789265148.217375:0:5841:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789265148.217401:0:5841:0:(import.c:65:import_set_state_nolock()) ffff8a1037e6c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789265148.217437:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c0d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876180414242816:12345-0@lo:38: Request processed in 133us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265148.217444:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789265148.217476:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a103c0d7b80 x1876180414242944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265164 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265148.217507:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876180414242944:0@lo:400: 00010000:00080000:1.0:1789265148.217532:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a103c078000 x1876180414242816/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789265158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265148.217538:0:3314:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789265148.217543:0:3314:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1789265148.217549:0:3314:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789265148.217553:0:3314:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789265148.217555:0:3314:0:(import.c:65:import_set_state_nolock()) ffff8a1037ed0000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789265148.217559:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c078000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3314:1876180414242816:0@lo:38: 00000040:00080000:0.0:1789265148.218291:0:6704:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:2.0:1789265148.218405:0:6680:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1789265148.218426:0:6680:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789265148.218447:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a101b596400/0x27274ba5bb951cd4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951cdb expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265148.218458:0:6680:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff8a101b596400/0x27274ba5bb951cd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951cdb expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789265148.218500:0:6680:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789265148.218502:0:6680:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789265148.218503:0:6680:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789265148.218504:0:6680:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789265148.218506:0:6680:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789265148.218507:0:6680:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789265148.218509:0:6680:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789265148.218510:0:6680:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789265148.218515:0:6680:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789265148.218517:0:6680:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789265148.218518:0:6680:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789265148.218521:0:6680:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1789265148.218524:0:6680:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789265148.218525:0:6680:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789265148.218526:0:6680:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789265148.218527:0:6680:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789265148.218528:0:6680:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789265148.218529:0:6680:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789265148.218530:0:6680:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789265148.218531:0:6680:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789265148.218532:0:6680:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789265148.218532:0:6680:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789265148.218533:0:6680:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789265148.218550:0:6680:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789265148.218564:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:6680:1876180414243072:0@lo:253: 00000100:00100000:2.0:1789265148.218635:0:6680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265148.218670:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414243072 00000100:00100000:2.0:1789265148.218675:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414243072 00000100:00100000:2.0:1789265148.218707:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789265148.218715:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+13:6680:x1876180414243072:12345-0@lo:253: 20000000:01000000:2.0:1789265148.218736:0:5834:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789265148.218749:0:5834:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1789265148.219828:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1007113240 going to sleep for 11 seconds 20000000:01000000:0.0:1789265148.255800:0:5834:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789265148.255820:0:5834:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1789265148.257301:0:5856:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789265148.257310:0:5856:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789265148.257334:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a10421eac00/0x27274ba5bb951cf7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265148.257351:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1017263c00/0x27274ba5bb951c5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb951c56 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265148.257359:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a10421eac00/0x27274ba5bb951cf7 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265148.257400:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1017263c00/0x27274ba5bb951c5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27274ba5bb951c56 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265148.257416:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a1017263c00/0x27274ba5bb951c5d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27274ba5bb951c56 expref: 13 pid: 5835 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265148.257439:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10088e5c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5856:1876180414243200:0@lo:104: 00000100:00100000:3.0:1789265148.257503:0:5856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265148.257576:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1016da2180 going to sleep for 11 seconds 00000100:00100000:0.0:1789265148.258019:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414243200 00000100:00100000:0.0:1789265148.258028:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414243200 00000100:00100000:0.0:1789265148.258103:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789265148.258113:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10088e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:871daf34-1206-40e7-bd71-78303abe4d37+3:5856:x1876180414243200:12345-0@lo:104: 00010000:00010000:0.0:1789265148.258125:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff8a10421eb400/0x27274ba5bb951c56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27274ba5bb951c5d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265148.258193:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789265148.258200:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10088e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:871daf34-1206-40e7-bd71-78303abe4d37+3:5856:x1876180414243200:12345-0@lo:104: Request processed in 89us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265148.258207:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1789265148.258228:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265148.258235:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff8a10421eb400/0x27274ba5bb951c56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27274ba5bb951c5d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265148.258243:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a10421eb400 already unused, calling callback (ffffffffc1ba2c20) 10000000:00010000:0.0:1789265148.258247:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff8a10421eb400/0x27274ba5bb951c56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x27274ba5bb951c5d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265148.258255:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff8a10421eb400/0x27274ba5bb951c56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x27274ba5bb951c5d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789265148.258276:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff8a10421eb400/0x27274ba5bb951c56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x27274ba5bb951c5d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265148.258282:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789265148.258310:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff8a10421eb400/0x27274ba5bb951c56 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951c5d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265148.258316:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789265148.258334:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff8a10421eb400/0x27274ba5bb951c56 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951c5d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265148.258341:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff8a10421eb400/0x27274ba5bb951c56 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951c5d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265148.258364:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265148.258365:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265148.258367:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265148.258379:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789265148.258388:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c079f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:871daf34-1206-40e7-bd71-78303abe4d37:3317:1876180414243328:0@lo:103: 00000100:00100000:0.0:1789265148.258418:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265148.258544:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10088e5c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5856:1876180414243200:0@lo:104: 00010000:00010000:3.0:1789265148.258563:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a10421eac00/0x27274ba5bb951cf7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265148.259132:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414243328 00000100:00100000:1.0:1789265148.259139:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414243328 00010000:00010000:1.0:1789265148.259176:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1017263c00/0x27274ba5bb951c5d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27274ba5bb951c56 expref: 14 pid: 5835 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265148.259260:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789265148.259270:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10119dc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:871daf34-1206-40e7-bd71-78303abe4d37+14:3317:x1876180414243328:12345-0@lo:103: 00010000:00010000:1.0:1789265148.259284:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265148.259290:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1017263c00/0x27274ba5bb951c5d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27274ba5bb951c56 expref: 14 pid: 5835 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265148.259314:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1017263c00/0x27274ba5bb951c5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27274ba5bb951c56 expref: 14 pid: 5835 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265148.259329:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1017263c00/0x27274ba5bb951c5d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27274ba5bb951c56 expref: 14 pid: 5835 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265148.259344:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a10421eac00/0x27274ba5bb951cf7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265148.259361:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a10421eac00/0x27274ba5bb951cf7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789265148.259376:0:5827:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002067533s 00010000:00010000:1.0:1789265148.259381:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a10421eac00/0x27274ba5bb951cf7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265148.259388:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a10421eac00/0x27274ba5bb951cf7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265148.259395:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a10421eac00/0x27274ba5bb951cf7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265148.259401:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a10421eac00/0x27274ba5bb951cf7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265148.259408:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a10421eac00 already unused, calling callback (ffffffffc1581350) 00010000:00010000:1.0:1789265148.259412:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a10421eac00/0x27274ba5bb951cf7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265148.259419:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a10421eac00/0x27274ba5bb951cf7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265148.259437:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a10421eac00/0x27274ba5bb951cf7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265148.259445:0:5856:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a10421eac00/0x27274ba5bb951cf7 lrc: 2/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265148.259447:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789265148.259457:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a10421eac00/0x27274ba5bb951cf7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265148.259465:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a10421eac00/0x27274ba5bb951cf7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265148.259499:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10119dc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:871daf34-1206-40e7-bd71-78303abe4d37+13:3317:x1876180414243328:12345-0@lo:103: Request processed in 230us (1080us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265148.259506:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789265148.259679:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c079f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:871daf34-1206-40e7-bd71-78303abe4d37:3317:1876180414243328:0@lo:103: 00000100:00100000:0.0:1789265148.274967:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+12:6680:x1876180414243072:12345-0@lo:253: Request processed in 56244us (56324us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265148.274996:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789265148.275171:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:6680:1876180414243072:0@lo:253: 10000000:01000000:3.0:1789265148.275186:0:6680:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789265148.275190:0:6680:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789265148.275191:0:6680:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789265148.275192:0:6680:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789265148.275193:0:6680:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789265148.275194:0:6680:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789265148.275195:0:6680:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789265148.275197:0:6680:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789265148.275198:0:6680:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789265148.275199:0:6680:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789265148.275200:0:6680:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789265148.275202:0:6680:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789265148.275223:0:6680:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789265148.279837:0:6680:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1789265148.280131:0:6680:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789265148.280372:0:6680:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1789265148.280533:0:6680:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789265148.280858:0:6680:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1789265148.281280:0:6680:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1789265148.283261:0:6680:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1789265148.553775:0:6680:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1789265148.553783:0:6680:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1789265148.553814:0:6680:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789265148.553875:0:6680:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.137@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789265148.553890:0:6680:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1789265148.553916:0:6680:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1789265149.235403:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265150.259348:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265151.283700:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789265151.666510:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789265151.666522:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a10202ad000 from 21 10000000:01000000:0.0:1789265151.666530:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789265151.666590:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a1017263000/0x27274ba5bb951cfe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265151.666605:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff8a1017263000/0x27274ba5bb951cfe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265151.666619:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff8a1017263000/0x27274ba5bb951cfe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265151.666649:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c078a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414243456:0@lo:101: 00000100:00100000:0.0:1789265151.666739:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265151.666881:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1011857540 going to sleep for 11 seconds 00000100:00100000:1.0:1789265151.666975:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414243456 00000100:00100000:1.0:1789265151.666986:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414243456 00000100:00100000:1.0:1789265151.667300:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789265151.667312:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+12:5837:x1876180414243456:12345-0@lo:101: 00010000:00010000:1.0:1789265151.667329:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265151.667347:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a101b597000/0x27274ba5bb951d05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x27274ba5bb951cfe expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265151.667380:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a101b597000/0x27274ba5bb951d05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27274ba5bb951cfe expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265151.667392:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a101b597000/0x27274ba5bb951d05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb951cfe expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265151.667403:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a101b597000, rc 0) 00000100:00100000:1.0:1789265151.667468:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+13:5837:x1876180414243456:12345-0@lo:101: Request processed in 158us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265151.667475:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789265151.667560:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c078a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414243456:0@lo:101: 00010000:00010000:0.0:1789265151.667579:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff8a1017263000/0x27274ba5bb951cfe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951d05 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265151.667590:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff8a1017263000/0x27274ba5bb951cfe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x27274ba5bb951d05 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265151.667665:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c078a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414243584:0@lo:501: 00000100:00100000:0.0:1789265151.667696:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265151.669680:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1011857540 going to sleep for 11 seconds 00000100:00100000:3.0:1789265151.669832:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414243584 00000100:00100000:3.0:1789265151.669844:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414243584 00000100:00100000:3.0:1789265151.669901:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789265151.669912:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+13:5837:x1876180414243584:12345-0@lo:501: 00000100:00100000:3.0:1789265151.671577:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+13:5837:x1876180414243584:12345-0@lo:501: Request processed in 1658us (3871us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265151.671592:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789265151.678613:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c078a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414243584:0@lo:501: 00000100:00100000:0.0:1789265151.678766:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c078a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414243712:0@lo:503: 00000100:00100000:0.0:1789265151.678866:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265151.678937:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1011857540 going to sleep for 11 seconds 00000100:00100000:3.0:1789265151.679033:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414243712 00000100:00100000:3.0:1789265151.679048:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414243712 00000100:00100000:3.0:1789265151.679143:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789265151.679155:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+13:5837:x1876180414243712:12345-0@lo:503: 00000100:00100000:3.0:1789265151.679466:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+13:5837:x1876180414243712:12345-0@lo:503: Request processed in 313us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265151.679476:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789265151.680811:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c078a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414243712:0@lo:503: 00000100:00100000:0.0:1789265151.681541:0:6868:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c078a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:6868:1876180414243840:0@lo:502: 00000100:00100000:0.0:1789265151.681638:0:6868:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265151.681691:0:6868:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1011857840 going to sleep for 11 seconds 00000100:00100000:2.0:1789265151.681742:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414243840 00000100:00100000:2.0:1789265151.681750:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414243840 00000100:00100000:2.0:1789265151.681804:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789265151.681815:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+13:6868:x1876180414243840:12345-0@lo:502: 00000100:00100000:2.0:1789265151.682165:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+13:6868:x1876180414243840:12345-0@lo:502: Request processed in 351us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265151.682174:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789265151.682415:0:6868:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c078a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:6868:1876180414243840:0@lo:502: 00000100:00100000:3.0:1789265151.682473:0:6868:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10088e5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:6868:1876180414243968:0@lo:502: 00000100:00100000:3.0:1789265151.682512:0:6868:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265151.682535:0:6868:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1002f039c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265151.682644:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414243968 00000100:00100000:0.0:1789265151.682650:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414243968 00000100:00100000:0.0:1789265151.682680:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789265151.682688:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+13:6868:x1876180414243968:12345-0@lo:502: 00000100:00100000:0.0:1789265151.682855:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+13:6868:x1876180414243968:12345-0@lo:502: Request processed in 166us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265151.682862:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789265151.682949:0:6868:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10088e5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:6868:1876180414243968:0@lo:502: 00000040:00080000:3.0:1789265151.682971:0:6868:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1789265151.683264:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1789265151.683288:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789265151.683300:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a1017263000/0x27274ba5bb951cfe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951d05 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265151.683312:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff8a1017263000/0x27274ba5bb951cfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951d05 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265151.683323:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789265151.683326:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a10202ad000 from 4 10000000:01000000:0.0:1789265151.683330:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789265151.683361:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a1017262e00/0x27274ba5bb951d0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265151.683381:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff8a1017262e00/0x27274ba5bb951d0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265151.683393:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff8a1017262e00/0x27274ba5bb951d0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265151.683407:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c07b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414244096:0@lo:101: 00000100:00100000:0.0:1789265151.683438:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265151.683471:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1011857e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789265151.683583:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414244096 00000100:00100000:2.0:1789265151.683589:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414244096 00000100:00100000:2.0:1789265151.683624:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789265151.683631:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+13:5837:x1876180414244096:12345-0@lo:101: 00010000:00010000:2.0:1789265151.683640:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265151.683655:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1042045200/0x27274ba5bb951d13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27274ba5bb951d0c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265151.683678:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1042045200/0x27274ba5bb951d13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27274ba5bb951d0c expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265151.683689:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1042045200/0x27274ba5bb951d13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb951d0c expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265151.683699:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1042045200, rc 0) 00000100:00100000:2.0:1789265151.683746:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+14:5837:x1876180414244096:12345-0@lo:101: Request processed in 115us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265151.683752:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789265151.684070:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c07b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414244096:0@lo:101: 00010000:00010000:0.0:1789265151.684117:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff8a1017262e00/0x27274ba5bb951d0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951d13 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265151.684138:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff8a1017262e00/0x27274ba5bb951d0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27274ba5bb951d13 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265151.684192:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c07b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414244224:0@lo:256: 00000100:00100000:0.0:1789265151.684455:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265151.684486:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1011857e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789265151.684547:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414244224 00000100:00100000:2.0:1789265151.684553:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414244224 00000100:00100000:2.0:1789265151.684614:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789265151.684622:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10119dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+14:5837:x1876180414244224:12345-0@lo:256: 20000000:01000000:2.0:1789265151.684640:0:5834:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789265151.684661:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789265151.684664:0:5834:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1789265151.684759:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10119dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+14:5837:x1876180414244224:12345-0@lo:256: Request processed in 137us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265151.684766:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789265151.684820:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c07b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414244224:0@lo:256: 10000000:01000000:0.0:1789265151.684870:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789265151.684877:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a1017262e00/0x27274ba5bb951d0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951d13 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265151.684886:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff8a1017262e00/0x27274ba5bb951d0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951d13 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265151.684905:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789265151.684907:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1789265151.684911:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789265151.684933:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a1017262c00/0x27274ba5bb951d1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265151.684941:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff8a1017262c00/0x27274ba5bb951d1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265151.684950:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff8a1017262c00/0x27274ba5bb951d1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265151.684962:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c07b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414244352:0@lo:101: 00000100:00100000:0.0:1789265151.684986:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265151.688732:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1011857e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789265151.688827:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414244352 00000100:00100000:3.0:1789265151.688840:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414244352 00000100:00100000:3.0:1789265151.688913:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789265151.688924:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10119ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+14:5837:x1876180414244352:12345-0@lo:101: 00010000:00010000:3.0:1789265151.688945:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265151.688969:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a10421eac00/0x27274ba5bb951d21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x27274ba5bb951d1a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265151.689017:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a10421eac00/0x27274ba5bb951d21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27274ba5bb951d1a expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265151.689032:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a10421eac00/0x27274ba5bb951d21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb951d1a expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265151.689043:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a10421eac00, rc 0) 00000100:00100000:3.0:1789265151.689188:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10119ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+15:5837:x1876180414244352:12345-0@lo:101: Request processed in 265us (4199us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265151.689195:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789265151.689379:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c07b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414244352:0@lo:101: 00010000:00010000:0.0:1789265151.689399:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff8a1017262c00/0x27274ba5bb951d1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951d21 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265151.689410:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff8a1017262c00/0x27274ba5bb951d1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x27274ba5bb951d21 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265151.689493:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c07b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414244480:0@lo:501: 00000100:00100000:0.0:1789265151.689534:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265151.689569:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1011857e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789265151.689614:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414244480 00000100:00100000:3.0:1789265151.689619:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414244480 00000100:00100000:3.0:1789265151.689638:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789265151.689644:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10119dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+15:5837:x1876180414244480:12345-0@lo:501: 00000100:00100000:3.0:1789265151.689956:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10119dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+15:5837:x1876180414244480:12345-0@lo:501: Request processed in 310us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265151.689965:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789265151.690112:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c07b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414244480:0@lo:501: 00000100:00100000:0.0:1789265151.690154:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c07b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414244608:0@lo:503: 00000100:00100000:0.0:1789265151.690216:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265151.690242:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1011857e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789265151.690303:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414244608 00000100:00100000:3.0:1789265151.690310:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414244608 00000100:00100000:3.0:1789265151.690379:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789265151.690390:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10119dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+15:5837:x1876180414244608:12345-0@lo:503: 00000100:00100000:3.0:1789265151.690684:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10119dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+15:5837:x1876180414244608:12345-0@lo:503: Request processed in 296us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265151.690692:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789265151.691752:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c07b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414244608:0@lo:503: 00000100:00100000:2.0:1789265151.692516:0:6869:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:6869:1876180414244736:0@lo:502: 00000100:00100000:2.0:1789265151.692609:0:6869:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265151.692659:0:6869:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1007fe7480 going to sleep for 11 seconds 00000100:00100000:3.0:1789265151.692713:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414244736 00000100:00100000:3.0:1789265151.692720:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414244736 00000100:00100000:3.0:1789265151.692770:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789265151.692781:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10119df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+15:6869:x1876180414244736:12345-0@lo:502: 00000100:00100000:3.0:1789265151.693217:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10119df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+15:6869:x1876180414244736:12345-0@lo:502: Request processed in 436us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265151.693224:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789265151.693464:0:6869:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:6869:1876180414244736:0@lo:502: 00000020:01000000:0.0:1789265151.693504:0:6869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789265151.693515:0:6869:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1789265151.693525:0:6869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265151.693528:0:6869:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1789265151.693534:0:6869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789265151.693539:0:6869:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.137@tcp to nid 0x20000c0a8cb89 (192.168.203.137@tcp) 00000020:01000000:0.0:1789265151.693566:0:6869:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789265151.693568:0:6869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789265151.693587:0:6869:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8a1037eccd28) 00000020:00000080:0.0:1789265151.693613:0:6869:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1789265151.693620:0:6869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789265151.693714:0:6869:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1789265151.693721:0:6869:0:(osd_handler.c:1573:osd_obd_connect()) connect #5 00000020:00000080:0.0:1789265151.693729:0:6869:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x27274ba5bb951d2f 00010000:00080000:0.0:1789265151.693766:0:6869:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a1037ed1800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.137@tcp at head 00010000:00010000:0.0:1789265151.694042:0:6869:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1789265151.756547:0:6869:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1789265151.756578:0:6869:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789265151.757301:0:6869:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789265151.759541:0:6869:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789265151.759630:0:6869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1789265151.759704:0:6869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1789265151.760417:0:6874:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789265151.760423:0:6874:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1789265151.761240:0:6869:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789265151.761257:0:6869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789265151.761294:0:6869:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789265151.761320:0:6869:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x27274ba5bb951d36 00000100:00080000:3.0:1789265151.761340:0:6869:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789265151.761347:0:6869:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8a1037ed1800 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:3.0:1789265151.761393:0:6869:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a10088e5c00 x1876180414244864/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789265151.761412:0:6869:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1789265151.761475:0:6869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265151.761480:0:6869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265151.761482:0:6869:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789265151.761485:0:6869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265151.761490:0:6869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265151.761491:0:6869:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789265151.761494:0:6869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789265151.761496:0:6869:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789265151.761515:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10088e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1876180414244864:0@lo:8: 00000100:00100000:3.0:1789265151.761524:0:6869:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10088e6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:6869:1876180414244992:0@lo:502: 00000100:00100000:0.0:1789265151.763391:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c07b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876180414245120:0@lo:400: 00000100:00100000:3.0:1789265151.765336:0:6869:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265151.765336:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265151.765573:0:6869:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1008da6000 going to sleep for 11 seconds 00000100:00100000:0.0:1789265151.765756:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265151.765811:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789265151.765844:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c079180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1876180414245248:0@lo:400: 00000100:00100000:0.0:1789265151.765902:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265151.766018:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414244992 00000100:00100000:2.0:1789265151.766140:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414245120 00000100:00100000:2.0:1789265151.766151:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414245120 00000100:00100000:1.0:1789265151.766157:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414244992 00000100:00100000:2.0:1789265151.766199:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414245248 00000100:00100000:2.0:1789265151.766202:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414245248 00000100:00100000:1.0:1789265151.766204:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789265151.766214:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10119de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+15:6869:x1876180414244992:12345-0@lo:502: 00000100:00100000:2.0:1789265151.766229:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789265151.766235:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c079880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876180414245120:12345-0@lo:400: 00000100:00100000:2.0:1789265151.766293:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c079880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876180414245120:12345-0@lo:400: Request processed in 58us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265151.766300:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789265151.766319:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789265151.766324:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c078a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876180414245248:12345-0@lo:400: 00000100:00100000:2.0:1789265151.766350:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c078a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876180414245248:12345-0@lo:400: Request processed in 27us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265151.766355:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1789265151.766387:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265151.766624:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10119de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+15:6869:x1876180414244992:12345-0@lo:502: Request processed in 411us (1297us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265151.766631:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789265151.766678:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414244864 00000100:00100000:1.0:1789265151.766681:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414244864 00000100:00100000:1.0:1789265151.766708:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789265151.766713:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c0d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3314:x1876180414244864:12345-0@lo:8: 00010000:00080000:1.0:1789265151.766738:0:6682:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 197 last 0 00000020:00000080:1.0:1789265151.766769:0:6682:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x27274ba5bb951d3d 00002000:00100000:1.0:1789265151.766818:0:6682:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8a1037e68800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113969 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1789265151.766823:0:6682:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:1.0:1789265151.766827:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1789265151.766958:0:6682:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789265151.767221:0:6682:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789265151.767253:0:6682:0:(import.c:65:import_set_state_nolock()) ffff8a1037e6b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789265151.767308:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c0d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1876180414244864:12345-0@lo:8: Request processed in 593us (1978us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265151.767315:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789265151.767496:0:6869:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10088e6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:6869:1876180414244992:0@lo:502: 00000020:01000000:2.0:1789265151.767545:0:6869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265151.767553:0:6869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265151.767566:0:6869:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789265151.767571:0:6869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00010000:00080000:1.0:1789265151.767903:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a10088e5c00 x1876180414244864/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789265161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265151.767916:0:3314:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789265151.767924:0:3314:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1789265151.767933:0:3314:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789265151.767939:0:3314:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1789265151.767952:0:3314:0:(import.c:65:import_set_state_nolock()) ffff8a1037ed1800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789265151.767973:0:3314:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789265151.767979:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10088e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1876180414244864:0@lo:8: 00000004:00080000:3.0:1789265151.768121:0:6874:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789265151.768242:0:6874:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 197573166381ns, next at 0ns, rc = 0 00010000:00080000:1.0:1789265151.769956:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a103c079180 x1876180414245248/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265151.769989:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c079180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1876180414245248:0@lo:400: 00010000:00080000:1.0:1789265151.770008:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a103c07b800 x1876180414245120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265151.770018:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c07b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876180414245120:0@lo:400: 00000020:01000000:1.0:1789265151.774223:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1789265151.774270:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789265151.774285:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a1017262c00/0x27274ba5bb951d1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951d21 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265151.774300:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff8a1017262c00/0x27274ba5bb951d1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951d21 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265151.774314:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789265151.774317:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8a10087899b8 from 1 10000000:01000000:1.0:1789265151.774321:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789265151.774388:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a101b597c00/0x27274ba5bb951d44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265151.774398:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff8a101b597c00/0x27274ba5bb951d44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265151.774411:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff8a101b597c00/0x27274ba5bb951d44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265151.774466:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414245376:0@lo:101: 00000100:00100000:1.0:1789265151.774560:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265151.774636:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a0f0112e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265151.786948:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414245376 00000100:00100000:3.0:1789265151.786973:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414245376 00000100:00100000:3.0:1789265151.787045:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789265151.787057:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10119dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+15:5837:x1876180414245376:12345-0@lo:101: 00010000:00010000:3.0:1789265151.787137:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265151.787163:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a10421eb400/0x27274ba5bb951d4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x27274ba5bb951d44 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265151.787202:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a10421eb400/0x27274ba5bb951d4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27274ba5bb951d44 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265151.787215:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a10421eb400/0x27274ba5bb951d4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb951d44 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265151.787237:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a10421eb400, rc 0) 00000100:00100000:3.0:1789265151.787343:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10119dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+16:5837:x1876180414245376:12345-0@lo:101: Request processed in 287us (12782us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265151.787350:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789265151.787433:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414245376:0@lo:101: 00010000:00010000:3.0:1789265151.787456:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff8a101b597c00/0x27274ba5bb951d44 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951d4b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265151.787467:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff8a101b597c00/0x27274ba5bb951d44 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x27274ba5bb951d4b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265151.787550:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10088e5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414245504:0@lo:501: 00000100:00100000:3.0:1789265151.787587:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265151.787625:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1008da6780 going to sleep for 11 seconds 00000100:00100000:3.0:1789265151.787643:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414245504 00000100:00100000:3.0:1789265151.787647:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414245504 00000100:00100000:3.0:1789265151.787670:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789265151.787676:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10119dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+16:5837:x1876180414245504:12345-0@lo:501: 00000100:00100000:3.0:1789265151.787943:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10119dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+16:5837:x1876180414245504:12345-0@lo:501: Request processed in 265us (355us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789265151.787950:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789265151.787980:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10088e5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414245504:0@lo:501: 10000000:01000000:3.0:1789265151.788005:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789265151.788013:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a101b597c00/0x27274ba5bb951d44 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951d4b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265151.788034:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff8a101b597c00/0x27274ba5bb951d44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951d4b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789265151.827544:0:6875:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1789265151.827587:0:6875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6875:1876180414245760:0@lo:7: 00000100:00100000:2.0:1789265151.827684:0:6875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265151.827754:0:6875:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1007fe7180 going to sleep for 11 seconds 00000004:00080000:2.0:1789265151.827794:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:2.0:1789265151.827860:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414245632:0@lo:13: 00000100:00100000:2.0:1789265151.827891:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265151.827945:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414245760 00000100:00100000:2.0:1789265151.827954:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414245760 00000100:00100000:2.0:1789265151.828301:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789265151.828311:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c0d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6875:x1876180414245760:12345-0@lo:7: 00000100:00100000:0.0:1789265151.832023:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414245632 00000100:00100000:0.0:1789265151.832041:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414245632 00000100:00100000:0.0:1789265151.832138:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789265151.832151:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c0d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1876180414245632:12345-0@lo:13: 00002000:00000024:0.0:1789265151.832193:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1789265151.832307:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c0d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1876180414245632:12345-0@lo:13: Request processed in 158us (4414us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265151.832314:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1789265151.836604:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789265151.836680:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a103c0d1880 x1876180414245632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265167 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265151.836709:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414245632:0@lo:13: 00002000:00080000:2.0:1789265151.838061:0:6685:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1789265151.838070:0:6685:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1789265151.838214:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c0d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6875:x1876180414245760:12345-0@lo:7: Request processed in 9900us (10526us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265151.838226:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789265151.838447:0:6875:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a103c0d3b80 x1876180414245760/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789265167 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265151.838463:0:6875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6875:1876180414245760:0@lo:7: 00000004:00080000:1.0:1789265151.838479:0:6875:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1789265151.838528:0:6875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6875:1876180414245888:0@lo:5: 00000100:00100000:1.0:1789265151.838574:0:6875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265151.838633:0:6875:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a0f0112e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265151.838705:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414245888 00000100:00100000:0.0:1789265151.838714:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414245888 00000100:00100000:0.0:1789265151.838766:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789265151.838776:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c0d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6875:x1876180414245888:12345-0@lo:5: 00002000:00080000:0.0:1789265151.838807:0:6684:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1789265151.838811:0:6684:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1789265151.839371:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c0d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6875:x1876180414245888:12345-0@lo:5: Request processed in 595us (795us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1789265151.839379:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789265151.839624:0:6875:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a103c0d5180 x1876180414245888/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789265167 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265151.839639:0:6875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6875:1876180414245888:0@lo:5: 00000004:00080000:2.0:1789265151.839650:0:6875:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1789265151.839681:0:6875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6875:1876180414246016:0@lo:700: 00000100:00100000:2.0:1789265151.839710:0:6875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265151.839744:0:6875:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1007fe7cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265151.839805:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414246016 00000100:00100000:1.0:1789265151.839811:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414246016 00000100:00100000:1.0:1789265151.839847:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789265151.839854:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c0d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6875:x1876180414246016:12345-0@lo:700: 00000100:00100000:1.0:1789265151.839883:0:6691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d6300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6691:1876180414246144:0@lo:700: 00000100:00100000:1.0:1789265151.839912:0:6691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265151.839937:0:6691:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a0f0112e180 going to sleep for 11 seconds 00000100:00100000:3.0:1789265151.839948:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414246144 00000100:00100000:3.0:1789265151.839953:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414246144 00000100:00100000:3.0:1789265151.840058:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789265151.840067:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c0d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6691:x1876180414246144:12345-0@lo:700: 40000000:02000000:3.0:1789265151.879536:0:5847:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:3.0:1789265151.887320:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c0d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6691:x1876180414246144:12345-0@lo:700: Request processed in 47242us (47393us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265151.887337:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789265151.887443:0:6691:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a103c0d6300 x1876180414246144/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789265167 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265151.887462:0:6691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d6300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6691:1876180414246144:0@lo:700: 40000000:02000000:2.0:1789265151.887496:0:6691:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:2.0:1789265151.983413:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c0d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6875:x1876180414246016:12345-0@lo:700: Request processed in 143543us (143686us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265151.983447:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789265151.983656:0:6875:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a103c0d1880 x1876180414246016/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789265167 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265151.983676:0:6875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6875:1876180414246016:0@lo:700: 00000001:00080000:0.0:1789265151.984276:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:0.0:1789265151.984294:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000004:02000040:1.0:1789265152.017315:0:6875:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:0.0:1789265152.021739:0:6875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c079f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6875:1876180414246272:0@lo:5: 00000100:00100000:0.0:1789265152.021846:0:6875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265152.021879:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414246272 00000100:00100000:2.0:1789265152.021889:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414246272 00000100:00100000:0.0:1789265152.021906:0:6875:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10088b0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265152.021958:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789265152.022513:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c07a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6875:x1876180414246272:12345-0@lo:5: 00002000:00080000:0.0:1789265152.030668:0:6685:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1789265152.030698:0:6685:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:0.0:1789265152.037173:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c07a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6875:x1876180414246272:12345-0@lo:5: Request processed in 14996us (15118us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1789265152.037200:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789265152.037268:0:6875:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a103c079f80 x1876180414246272/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789265168 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265152.037284:0:6875:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1789265152.037301:0:6875:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8a103c079f80 x1876180414246272/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789265168 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265152.037314:0:6875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c079f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6875:1876180414246272:0@lo:5: 00000004:00080000:0.0:1789265152.037332:0:6875:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1789265152.311211:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265153.330289:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265154.355228:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789265154.681658:0:7051:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg337-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789265155.384315:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265156.402446:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265156.919448:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789265156.919479:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414246400:0@lo:13: 00000100:00100000:3.0:1789265156.919626:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265156.919704:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876180414246656:0@lo:400: 00000100:00100000:3.0:1789265156.919745:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1876180414246784:0@lo:400: 00000100:00100000:2.0:1789265156.919750:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265156.919767:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414246912:0@lo:400: 00000100:00100000:2.0:1789265156.919776:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789265156.919782:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:871daf34-1206-40e7-bd71-78303abe4d37:3316:1876180414246528:0@lo:400: 00000100:00100000:3.0:1789265156.919788:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265156.919817:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265156.919817:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265156.919857:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414246656 00000100:00100000:3.0:1789265156.919858:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414246784 00000100:00100000:1.0:1789265156.919860:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414246912 00000100:00100000:2.0:1789265156.919864:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414246656 00000100:00100000:3.0:1789265156.919865:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414246784 00000100:00100000:1.0:1789265156.919865:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414246912 00000100:00100000:2.0:1789265156.919909:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789265156.919909:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789265156.919917:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789265156.919922:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c0d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876180414246656:12345-0@lo:400: 00000100:00100000:1.0:1789265156.919922:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c0d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3318:x1876180414246912:12345-0@lo:400: 00000100:00100000:3.0:1789265156.919932:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10088e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876180414246784:12345-0@lo:400: 00000100:00100000:2.0:1789265156.919973:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c0d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876180414246656:12345-0@lo:400: Request processed in 56us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265156.919973:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c0d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3318:x1876180414246912:12345-0@lo:400: Request processed in 56us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265156.919981:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789265156.919981:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1789265156.920000:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789265156.920003:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789265156.920028:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a103c0d0380 x1876180414246656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265156.920042:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876180414246656:0@lo:400: 00000100:00100000:3.0:1789265156.920057:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10088e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876180414246784:12345-0@lo:400: Request processed in 127us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265156.920065:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789265156.920110:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414246528 00000100:00100000:2.0:1789265156.920115:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414246528 00010000:00080000:3.0:1789265156.920140:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a103c0d2a00 x1876180414246784/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265156.920146:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789265156.920156:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a100881c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+16:3316:x1876180414246528:12345-0@lo:400: 00000100:00100000:3.0:1789265156.920174:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1876180414246784:0@lo:400: 00000100:00100000:2.0:1789265156.920197:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a100881c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+16:3316:x1876180414246528:12345-0@lo:400: Request processed in 40us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265156.920204:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789265156.920235:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:871daf34-1206-40e7-bd71-78303abe4d37:3316:1876180414246528:0@lo:400: 00000100:00100000:0.0:1789265156.923476:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414246400 00000100:00100000:0.0:1789265156.923493:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414246400 00000100:00100000:0.0:1789265156.923572:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789265156.923583:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10088e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1876180414246400:12345-0@lo:13: 00002000:00000024:0.0:1789265156.923620:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00010000:00080000:1.0:1789265156.934368:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a103c0d1500 x1876180414246912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265156.934391:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414246912:0@lo:400: 00000100:00100000:0.0:1789265156.934857:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10088e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1876180414246400:12345-0@lo:13: Request processed in 11274us (15295us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265156.934870:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789265156.935229:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a103c0d3480 x1876180414246400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265172 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265156.935251:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414246400:0@lo:13: 00000001:00080000:1.0:1789265157.015821:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:3.0:1789265157.430652:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265158.450226:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265159.475121:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265160.498239:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265161.523214:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265162.034395:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876180414247168:0@lo:400: 00000100:00100000:2.0:1789265162.034465:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265162.034529:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789265162.034537:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:871daf34-1206-40e7-bd71-78303abe4d37:3316:1876180414247040:0@lo:400: 00000100:00100000:2.0:1789265162.034565:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265162.034598:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414247168 00000100:00100000:2.0:1789265162.034605:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414247168 00000100:00100000:2.0:1789265162.034647:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789265162.034656:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c0d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876180414247168:12345-0@lo:400: 00000100:00100000:2.0:1789265162.034704:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c0d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876180414247168:12345-0@lo:400: Request processed in 49us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265162.034711:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1789265162.034756:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a103c0d3480 x1876180414247168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265162.034770:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876180414247168:0@lo:400: 00000100:00100000:1.0:1789265162.035141:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1876180414247296:0@lo:400: 00000100:00100000:1.0:1789265162.035175:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265162.035205:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789265162.035211:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414247424:0@lo:400: 00000100:00100000:1.0:1789265162.035238:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265162.035268:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414247040 00000100:00100000:1.0:1789265162.035273:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414247040 00000100:00100000:1.0:1789265162.035302:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789265162.035309:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a100881f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+16:3316:x1876180414247040:12345-0@lo:400: 00000100:00100000:1.0:1789265162.035357:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a100881f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+16:3316:x1876180414247040:12345-0@lo:400: Request processed in 48us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265162.035364:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789265162.035390:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414247424 00000100:00100000:1.0:1789265162.035393:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414247424 00000100:00100000:1.0:1789265162.035424:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789265162.035430:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c0d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1876180414247424:12345-0@lo:400: 00000100:00100000:1.0:1789265162.035463:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c0d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1876180414247424:12345-0@lo:400: Request processed in 33us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265162.035470:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789265162.035555:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:871daf34-1206-40e7-bd71-78303abe4d37:3316:1876180414247040:0@lo:400: 00000100:00080000:1.0:1789265162.035575:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789265162.035597:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a103c0d1c00 x1876180414247424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265162.035606:0:3317:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1789265162.035618:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414247424:0@lo:400: 00000100:00100000:2.0:1789265162.035678:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414247296 00000100:00100000:2.0:1789265162.035682:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414247296 00000100:00100000:2.0:1789265162.035721:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789265162.035728:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c0d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876180414247296:12345-0@lo:400: 00000100:00100000:2.0:1789265162.035766:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c0d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876180414247296:12345-0@lo:400: Request processed in 38us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265162.035771:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789265162.036293:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c078e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414247552:0@lo:13: 00000100:00100000:2.0:1789265162.036327:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789265162.036375:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a103c0d1500 x1876180414247296/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265162.036385:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1876180414247296:0@lo:400: 00000100:00080000:2.0:1789265162.036401:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265162.036452:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414247552 00000100:00100000:3.0:1789265162.036459:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414247552 00000100:00100000:3.0:1789265162.036504:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789265162.036512:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c0d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414247552:12345-0@lo:13: 00002000:00000024:3.0:1789265162.036540:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789265162.036578:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c0d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414247552:12345-0@lo:13: Request processed in 67us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265162.036584:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789265162.036711:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a103c078e00 x1876180414247552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265178 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265162.036725:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c078e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414247552:0@lo:13: 00010000:00010000:2.0:1789265162.548549:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265163.573423:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265164.598553:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789265165.095315:0:7616:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789265165.095320:0:7616:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1789265165.095506:0:7616:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8a103bd8f000 00000020:01000004:2.0:1789265165.095529:0:7616:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1789265165.095544:0:7616:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1789265165.095635:0:7616:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8a1008f43370) 00000020:00000080:2.0:1789265165.095660:0:7616:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789265165.112924:0:7616:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1789265165.113257:0:7616:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1789265165.135929:0:7616:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1789265165.141459:0:7616:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789265165.141582:0:7616:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1789265165.141661:0:7616:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789265165.141691:0:7616:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1789265165.142251:0:7616:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789265165.142267:0:7616:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789265165.142280:0:7616:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x27274ba5bb951d59 00000020:01000004:2.0:1789265165.142290:0:7616:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1789265165.142316:0:7616:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.137@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789265165.142320:0:7616:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.137@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789265165.142327:0:7616:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789265165.142355:0:7616:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1789265165.142360:0:7616:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.137@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1789265165.160573:0:7616:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.137@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789265165.160625:0:7616:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.137@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1789265165.160630:0:7616:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789265165.160632:0:7616:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789265165.160634:0:7616:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789265165.160635:0:7616:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789265165.160636:0:7616:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789265165.160637:0:7616:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789265165.160639:0:7616:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789265165.160641:0:7616:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789265165.160642:0:7616:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789265165.160644:0:7616:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789265165.160646:0:7616:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789265165.160650:0:7616:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1789265165.160652:0:7616:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789265165.160654:0:7616:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789265165.160655:0:7616:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789265165.160656:0:7616:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789265165.160657:0:7616:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789265165.160658:0:7616:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789265165.160664:0:7616:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789265165.160665:0:7616:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789265165.160666:0:7616:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789265165.160667:0:7616:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789265165.160668:0:7616:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789265165.160715:0:7616:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789265165.160740:0:7616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10088e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:7616:1876180414247680:0@lo:253: 00000100:00100000:3.0:1789265165.160836:0:7616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265165.161290:0:7616:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10086f2180 going to sleep for 11 seconds 00000100:00100000:2.0:1789265165.161361:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414247680 00000100:00100000:2.0:1789265165.161371:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414247680 00000100:00100000:2.0:1789265165.161439:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789265165.161451:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a100881d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+16:7616:x1876180414247680:12345-0@lo:253: 20000000:01000000:2.0:1789265165.161494:0:5833:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1789265165.161499:0:5833:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1789265165.161506:0:5833:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1789265165.161510:0:5833:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1789265165.163360:0:5833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789265165.163608:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1789265165.163627:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1789265165.163672:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1789265165.163681:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1789265165.163712:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1789265165.163773:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1789265165.164608:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1789265165.164637:0:5833:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.137@tcp 20000000:01000000:2.0:1789265165.164639:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.137@tcp (null) (null) (null) 00000040:00080000:2.0:1789265165.164676:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1789265165.164695:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789265165.164749:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1789265165.164758:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.137@tcp (null) (null) 00000040:00080000:2.0:1789265165.164790:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1789265165.164800:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1789265165.164831:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1789265165.164883:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1789265165.165856:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:2.0:1789265165.165880:0:5833:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.137@tcp 20000000:01000000:2.0:1789265165.165883:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.137@tcp (null) (null) (null) 00000040:00080000:2.0:1789265165.165911:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:2.0:1789265165.165918:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1789265165.165943:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:2.0:1789265165.166000:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.137@tcp (null) (null) 00000040:00080000:2.0:1789265165.166043:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:2.0:1789265165.166053:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1789265165.166284:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:2.0:1789265165.166342:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:2.0:1789265165.166367:0:5833:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:2.0:1789265165.166371:0:5833:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1789265165.166377:0:5833:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1789265165.166396:0:5833:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789265165.166400:0:5833:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1789265165.166446:0:5833:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1789265165.166449:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789265165.168355:0:7618:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1789265165.168808:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1789265165.168864:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1789265165.169462:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1789265165.169482:0:5833:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789265165.169485:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789265165.170888:0:7619:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1789265165.170965:0:7619:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1789265165.171018:0:7619:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1789265165.171406:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:2.0:1789265165.171444:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:2.0:1789265165.171484:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:2.0:1789265165.171494:0:5833:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789265165.171497:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789265165.171938:0:7620:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:0.0:1789265165.171985:0:7620:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:0.0:1789265165.172045:0:7620:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1789265165.172307:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1789265165.172339:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1789265165.172383:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1789265165.172395:0:5833:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1789265165.172397:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789265165.172903:0:7621:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:0.0:1789265165.172957:0:7621:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:0.0:1789265165.172989:0:7621:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:2.0:1789265165.173334:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:2.0:1789265165.173373:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:2.0:1789265165.173416:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:2.0:1789265165.173430:0:5833:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:2.0:1789265165.173432:0:5833:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:2.0:1789265165.173443:0:5833:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789265165.173466:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a1042044200/0x27274ba5bb951d60 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265165.173488:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1042045a00/0x27274ba5bb951cb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb951caa expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265165.173497:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1017262200/0x27274ba5bb951cdb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb951cd4 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265165.173504:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a101b597000/0x27274ba5bb951d05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb951cfe expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265165.173510:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a10421eac00/0x27274ba5bb951d21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb951d1a expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265165.173517:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a10421eb400/0x27274ba5bb951d4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb951d44 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265165.173525:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a1042044200/0x27274ba5bb951d60 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265165.173577:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a10421eb400/0x27274ba5bb951d4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27274ba5bb951d44 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265165.173599:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a10421eb400/0x27274ba5bb951d4b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27274ba5bb951d44 expref: 16 pid: 5834 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265165.173616:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d1500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5833:1876180414247808:0@lo:104: 00000100:00100000:2.0:1789265165.173694:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789265165.173757:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a10421eac00/0x27274ba5bb951d21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27274ba5bb951d1a expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265165.173765:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a10421eac00/0x27274ba5bb951d21 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27274ba5bb951d1a expref: 16 pid: 5833 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265165.173773:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d1880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5833:1876180414247936:0@lo:104: 00010000:00010000:2.0:1789265165.173793:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a101b597000/0x27274ba5bb951d05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27274ba5bb951cfe expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265165.173801:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a101b597000/0x27274ba5bb951d05 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27274ba5bb951cfe expref: 16 pid: 5835 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265165.173809:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d3b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5833:1876180414248064:0@lo:104: 00010000:00010000:2.0:1789265165.173836:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1017262200/0x27274ba5bb951cdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27274ba5bb951cd4 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265165.173843:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a1017262200/0x27274ba5bb951cdb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27274ba5bb951cd4 expref: 16 pid: 5834 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265165.173851:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d1180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5833:1876180414248192:0@lo:104: 00010000:00010000:2.0:1789265165.173874:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1042045a00/0x27274ba5bb951cb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27274ba5bb951caa expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265165.173882:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a1042045a00/0x27274ba5bb951cb1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27274ba5bb951caa expref: 16 pid: 5833 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265165.173889:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d3800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5833:1876180414248320:0@lo:104: 00000100:00100000:2.0:1789265165.173903:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1037ebdb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789265165.173992:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789265165.174012:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265165.174119:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265165.174314:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265165.174334:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414247808 00000100:00100000:0.0:1789265165.174344:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414247808 00000100:00100000:0.0:1789265165.174387:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414247936 00000100:00100000:0.0:1789265165.174390:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414247936 00000100:00100000:0.0:1789265165.174401:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414248064 00000100:00100000:0.0:1789265165.174403:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414248064 00000100:00100000:0.0:1789265165.174417:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789265165.174427:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a100908a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:871daf34-1206-40e7-bd71-78303abe4d37+5:5833:x1876180414247808:12345-0@lo:104: 00010000:00010000:0.0:1789265165.174443:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff8a101b597c00/0x27274ba5bb951d44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x27274ba5bb951d4b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265165.174588:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789265165.174596:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a100908a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:871daf34-1206-40e7-bd71-78303abe4d37+5:5833:x1876180414247808:12345-0@lo:104: Request processed in 170us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265165.174604:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789265165.174628:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265165.174636:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414248192 00000100:00100000:3.0:1789265165.174639:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414248192 00000100:00100000:0.0:1789265165.174652:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414248320 00000100:00100000:0.0:1789265165.174655:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414248320 00000100:00100000:3.0:1789265165.174657:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789265165.174663:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10088e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:871daf34-1206-40e7-bd71-78303abe4d37+6:5833:x1876180414247936:12345-0@lo:104: 00010000:00010000:3.0:1789265165.174672:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff8a1017262c00/0x27274ba5bb951d1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x27274ba5bb951d21 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265165.174732:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789265165.174742:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789265165.174747:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10088e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:871daf34-1206-40e7-bd71-78303abe4d37+6:5833:x1876180414247936:12345-0@lo:104: Request processed in 84us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265165.174753:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789265165.174767:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789265165.174773:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10088e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:871daf34-1206-40e7-bd71-78303abe4d37+5:5833:x1876180414248064:12345-0@lo:104: 00010000:00010000:3.0:1789265165.174780:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff8a1017263000/0x27274ba5bb951cfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x27274ba5bb951d05 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265165.174789:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d1500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5833:1876180414247808:0@lo:104: 00000100:00100000:2.0:1789265165.174799:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d1880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5833:1876180414247936:0@lo:104: 00000100:00100000:2.0:1789265165.174806:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d3b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5833:1876180414248064:0@lo:104: 00010000:00010000:1.0:1789265165.175105:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff8a101b597c00/0x27274ba5bb951d44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x27274ba5bb951d4b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265165.175114:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b597c00 already unused, calling callback (ffffffffc1ba2c20) 10000000:00010000:1.0:1789265165.175119:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff8a101b597c00/0x27274ba5bb951d44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x27274ba5bb951d4b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265165.175128:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff8a101b597c00/0x27274ba5bb951d44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x27274ba5bb951d4b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265165.175154:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff8a101b597c00/0x27274ba5bb951d44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x27274ba5bb951d4b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265165.175161:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789265165.175208:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff8a101b597c00/0x27274ba5bb951d44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951d4b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265165.175214:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789265165.175237:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff8a101b597c00/0x27274ba5bb951d44 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951d4b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265165.175245:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff8a101b597c00/0x27274ba5bb951d44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951d4b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265165.175261:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789265165.175266:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff8a1017262c00/0x27274ba5bb951d1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x27274ba5bb951d21 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265165.175271:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1017262c00 already unused, calling callback (ffffffffc1ba2c20) 10000000:00010000:1.0:1789265165.175275:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff8a1017262c00/0x27274ba5bb951d1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x27274ba5bb951d21 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265165.175281:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff8a1017262c00/0x27274ba5bb951d1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x27274ba5bb951d21 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265165.175287:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff8a1017262c00/0x27274ba5bb951d1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x27274ba5bb951d21 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265165.175292:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789265165.175313:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff8a1017262c00/0x27274ba5bb951d1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951d21 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265165.175320:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789265165.175336:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff8a1017262c00/0x27274ba5bb951d1a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951d21 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265165.175342:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff8a1017262c00/0x27274ba5bb951d1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951d21 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265165.175353:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265165.175356:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff8a1017263000/0x27274ba5bb951cfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x27274ba5bb951d05 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265165.175407:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1017263000 already unused, calling callback (ffffffffc1ba2c20) 10000000:00010000:1.0:1789265165.175411:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff8a1017263000/0x27274ba5bb951cfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x27274ba5bb951d05 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265165.175418:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff8a1017263000/0x27274ba5bb951cfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x27274ba5bb951d05 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265165.175424:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff8a1017263000/0x27274ba5bb951cfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x27274ba5bb951d05 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265165.175429:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789265165.175443:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff8a1017263000/0x27274ba5bb951cfe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951d05 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265165.175448:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789265165.175452:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff8a1017263000/0x27274ba5bb951cfe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951d05 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265165.175467:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff8a1017263000/0x27274ba5bb951cfe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951d05 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265165.175478:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265165.175480:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265165.175482:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265165.175502:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:871daf34-1206-40e7-bd71-78303abe4d37:3316:1876180414248448:0@lo:103: 00000100:00100000:1.0:1789265165.175549:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265165.175607:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:871daf34-1206-40e7-bd71-78303abe4d37:3317:1876180414248576:0@lo:103: 00000100:00100000:1.0:1789265165.175632:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265165.175649:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789265165.175655:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:871daf34-1206-40e7-bd71-78303abe4d37:3317:1876180414248704:0@lo:103: 00000100:00100000:1.0:1789265165.175673:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265165.175706:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414248448 00000100:00100000:1.0:1789265165.175711:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414248448 00010000:00010000:1.0:1789265165.175736:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a10421eb400/0x27274ba5bb951d4b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27274ba5bb951d44 expref: 17 pid: 5834 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265165.175754:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414248576 00000100:00100000:1.0:1789265165.175757:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414248576 00010000:00010000:1.0:1789265165.175768:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a10421eac00/0x27274ba5bb951d21 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27274ba5bb951d1a expref: 18 pid: 5833 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265165.175779:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414248704 00000100:00100000:1.0:1789265165.175782:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414248704 00010000:00010000:1.0:1789265165.175793:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a101b597000/0x27274ba5bb951d05 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27274ba5bb951cfe expref: 19 pid: 5835 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265165.175807:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789265165.175821:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c0d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:871daf34-1206-40e7-bd71-78303abe4d37+19:3316:x1876180414248448:12345-0@lo:103: 00010000:00010000:1.0:1789265165.175834:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265165.175840:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a10421eb400/0x27274ba5bb951d4b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27274ba5bb951d44 expref: 19 pid: 5834 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265165.175855:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a10421eb400/0x27274ba5bb951d4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27274ba5bb951d44 expref: 19 pid: 5834 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265165.175872:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a10421eb400/0x27274ba5bb951d4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27274ba5bb951d44 expref: 19 pid: 5834 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265165.175901:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265165.175934:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c0d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:871daf34-1206-40e7-bd71-78303abe4d37+18:3316:x1876180414248448:12345-0@lo:103: Request processed in 114us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265165.175941:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789265165.175958:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789265165.175965:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c0d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:871daf34-1206-40e7-bd71-78303abe4d37+17:3317:x1876180414248576:12345-0@lo:103: 00010000:00010000:1.0:1789265165.175972:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265165.175976:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a10421eac00/0x27274ba5bb951d21 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27274ba5bb951d1a expref: 17 pid: 5833 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265165.175986:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a10421eac00/0x27274ba5bb951d21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27274ba5bb951d1a expref: 17 pid: 5833 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265165.175997:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a10421eac00/0x27274ba5bb951d21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27274ba5bb951d1a expref: 17 pid: 5833 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265165.176009:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265165.176046:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c0d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:871daf34-1206-40e7-bd71-78303abe4d37+16:3317:x1876180414248576:12345-0@lo:103: Request processed in 70us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265165.176062:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789265165.176104:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789265165.176111:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c0d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:871daf34-1206-40e7-bd71-78303abe4d37+15:3317:x1876180414248704:12345-0@lo:103: 00010000:00010000:1.0:1789265165.176119:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265165.176123:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a101b597000/0x27274ba5bb951d05 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27274ba5bb951cfe expref: 15 pid: 5835 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265165.176132:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a101b597000/0x27274ba5bb951d05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27274ba5bb951cfe expref: 15 pid: 5835 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265165.176143:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a101b597000/0x27274ba5bb951d05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27274ba5bb951cfe expref: 15 pid: 5835 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265165.176152:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265165.176174:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c0d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:871daf34-1206-40e7-bd71-78303abe4d37+14:3317:x1876180414248704:12345-0@lo:103: Request processed in 64us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265165.176180:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789265165.176220:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:871daf34-1206-40e7-bd71-78303abe4d37:3317:1876180414248704:0@lo:103: 00000100:00100000:1.0:1789265165.176229:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:871daf34-1206-40e7-bd71-78303abe4d37:3317:1876180414248576:0@lo:103: 00000100:00100000:1.0:1789265165.176257:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:871daf34-1206-40e7-bd71-78303abe4d37:3316:1876180414248448:0@lo:103: 00010000:00010000:0.0:1789265165.176492:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265165.176587:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1789265165.176603:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10088e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:871daf34-1206-40e7-bd71-78303abe4d37+5:5833:x1876180414248064:12345-0@lo:104: Request processed in 1829us (2483us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265165.176612:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789265165.176639:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789265165.176648:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10088e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:871daf34-1206-40e7-bd71-78303abe4d37+4:5833:x1876180414248192:12345-0@lo:104: 00010000:00010000:3.0:1789265165.176661:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff8a101b596400/0x27274ba5bb951cd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x27274ba5bb951cdb expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265165.176913:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789265165.176919:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10088e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:871daf34-1206-40e7-bd71-78303abe4d37+4:5833:x1876180414248192:12345-0@lo:104: Request processed in 273us (2605us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265165.176926:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789265165.176984:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789265165.176993:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10088e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:871daf34-1206-40e7-bd71-78303abe4d37+3:5833:x1876180414248320:12345-0@lo:104: 00010000:00010000:3.0:1789265165.177006:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff8a10421ea400/0x27274ba5bb951caa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x27274ba5bb951cb1 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265165.177052:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789265165.177058:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10088e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:871daf34-1206-40e7-bd71-78303abe4d37+3:5833:x1876180414248320:12345-0@lo:104: Request processed in 67us (2430us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265165.177064:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1789265165.177167:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789265165.177173:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff8a101b596400/0x27274ba5bb951cd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x27274ba5bb951cdb expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265165.177181:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b596400 already unused, calling callback (ffffffffc1ba2c20) 10000000:00010000:1.0:1789265165.177185:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff8a101b596400/0x27274ba5bb951cd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x27274ba5bb951cdb expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265165.177202:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff8a101b596400/0x27274ba5bb951cd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x27274ba5bb951cdb expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265165.177210:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff8a101b596400/0x27274ba5bb951cd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x27274ba5bb951cdb expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265165.177216:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789265165.177266:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff8a101b596400/0x27274ba5bb951cd4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951cdb expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265165.177272:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789265165.177288:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff8a101b596400/0x27274ba5bb951cd4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951cdb expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265165.177295:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff8a101b596400/0x27274ba5bb951cd4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951cdb expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265165.177305:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265165.177308:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff8a10421ea400/0x27274ba5bb951caa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27274ba5bb951cb1 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265165.177313:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a10421ea400 already unused, calling callback (ffffffffc1ba2c20) 10000000:00010000:1.0:1789265165.177316:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff8a10421ea400/0x27274ba5bb951caa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x27274ba5bb951cb1 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265165.177323:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff8a10421ea400/0x27274ba5bb951caa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x27274ba5bb951cb1 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265165.177329:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff8a10421ea400/0x27274ba5bb951caa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x27274ba5bb951cb1 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265165.177342:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789265165.177354:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff8a10421ea400/0x27274ba5bb951caa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951cb1 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265165.177360:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789265165.177364:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff8a10421ea400/0x27274ba5bb951caa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951cb1 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265165.177370:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff8a10421ea400/0x27274ba5bb951caa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951cb1 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265165.177384:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265165.177385:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265165.177387:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265165.177400:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:871daf34-1206-40e7-bd71-78303abe4d37:3315:1876180414248832:0@lo:103: 00000100:00100000:1.0:1789265165.177434:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265165.177465:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789265165.177470:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:871daf34-1206-40e7-bd71-78303abe4d37:3315:1876180414248960:0@lo:103: 00000100:00100000:1.0:1789265165.177485:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265165.177507:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414248832 00000100:00100000:1.0:1789265165.177513:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414248832 00010000:00010000:1.0:1789265165.177532:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1017262200/0x27274ba5bb951cdb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27274ba5bb951cd4 expref: 14 pid: 5834 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265165.177549:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414248960 00000100:00100000:1.0:1789265165.177551:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414248960 00010000:00010000:1.0:1789265165.177559:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1042045a00/0x27274ba5bb951cb1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27274ba5bb951caa expref: 15 pid: 5833 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265165.177584:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789265165.177590:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c0d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:871daf34-1206-40e7-bd71-78303abe4d37+15:3315:x1876180414248832:12345-0@lo:103: 00010000:00010000:1.0:1789265165.177600:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265165.177604:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1017262200/0x27274ba5bb951cdb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27274ba5bb951cd4 expref: 15 pid: 5834 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265165.177616:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1017262200/0x27274ba5bb951cdb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27274ba5bb951cd4 expref: 15 pid: 5834 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265165.177634:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265165.177661:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c0d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:871daf34-1206-40e7-bd71-78303abe4d37+15:3315:x1876180414248832:12345-0@lo:103: Request processed in 72us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265165.177667:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789265165.177679:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789265165.177684:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c0d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:871daf34-1206-40e7-bd71-78303abe4d37+14:3315:x1876180414248960:12345-0@lo:103: 00010000:00010000:1.0:1789265165.177691:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265165.177694:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1042045a00/0x27274ba5bb951cb1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27274ba5bb951caa expref: 14 pid: 5833 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265165.177703:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1042045a00/0x27274ba5bb951cb1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27274ba5bb951caa expref: 14 pid: 5833 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265165.177715:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a1042044200/0x27274ba5bb951d60 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265165.177723:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1042044200/0x27274ba5bb951d60 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265165.177748:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a1042044200/0x27274ba5bb951d60 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265165.177756:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a1042044200/0x27274ba5bb951d60 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265165.177762:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a1042044200/0x27274ba5bb951d60 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265165.177768:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a1042044200/0x27274ba5bb951d60 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265165.177772:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1042044200 already unused, calling callback (ffffffffc1581350) 00010000:00010000:1.0:1789265165.177777:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a1042044200/0x27274ba5bb951d60 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265165.177783:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a1042044200/0x27274ba5bb951d60 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265165.177790:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a1042044200/0x27274ba5bb951d60 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265165.177797:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265165.177819:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c0d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:871daf34-1206-40e7-bd71-78303abe4d37+14:3315:x1876180414248960:12345-0@lo:103: Request processed in 134us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265165.177829:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789265165.177861:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:871daf34-1206-40e7-bd71-78303abe4d37:3315:1876180414248960:0@lo:103: 00010000:00010000:2.0:1789265165.177880:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1017262200/0x27274ba5bb951cdb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27274ba5bb951cd4 expref: 13 pid: 5834 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265165.177892:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d1180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5833:1876180414248192:0@lo:104: 00010000:00010000:0.0:1789265165.177929:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265165.178059:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:871daf34-1206-40e7-bd71-78303abe4d37:3315:1876180414248832:0@lo:103: 00010000:00010000:2.0:1789265165.178384:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1042045a00/0x27274ba5bb951cb1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27274ba5bb951caa expref: 12 pid: 5833 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265165.178399:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d3800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5833:1876180414248320:0@lo:104: 00010000:00010000:2.0:1789265165.178436:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a1042044200/0x27274ba5bb951d60 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265165.178447:0:5833:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a1042044200/0x27274ba5bb951d60 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265165.178453:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a1042044200/0x27274ba5bb951d60 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265165.178473:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1042044200/0x27274ba5bb951d60 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789265165.178492:0:5833:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1789265165.224407:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a100881d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+11:7616:x1876180414247680:12345-0@lo:253: Request processed in 62943us (63555us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265165.224428:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789265165.224655:0:7616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10088e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:7616:1876180414247680:0@lo:253: 10000000:01000000:1.0:1789265165.224698:0:7616:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789265165.224702:0:7616:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789265165.224704:0:7616:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789265165.224706:0:7616:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789265165.224707:0:7616:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1789265165.224709:0:7616:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789265165.224711:0:7616:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789265165.224713:0:7616:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789265165.224715:0:7616:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1789265165.224717:0:7616:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789265165.224718:0:7616:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789265165.224744:0:7616:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a103bd8f000 from lustre-OST0001 10000000:01000000:1.0:1789265165.224779:0:7616:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1789265165.224782:0:7616:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789265165.224792:0:7616:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8a10087899b8 local copy 10000000:01000000:1.0:1789265165.224797:0:7616:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789265165.224847:0:7616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a101b596400/0x27274ba5bb951d67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265165.224860:0:7616:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.137@tcp lock: ffff8a101b596400/0x27274ba5bb951d67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265165.224872:0:7616:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff8a101b596400/0x27274ba5bb951d67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265165.224894:0:7616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:7616:1876180414249088:0@lo:101: 00000100:00100000:1.0:1789265165.224941:0:7616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265165.225011:0:7616:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103bec2c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789265165.225148:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414249088 00000100:00100000:2.0:1789265165.225157:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414249088 00000100:00100000:2.0:1789265165.225206:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789265165.225216:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a100881dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+11:7616:x1876180414249088:12345-0@lo:101: 00010000:00010000:2.0:1789265165.225231:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265165.225248:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1042044200/0x27274ba5bb951d6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27274ba5bb951d67 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265165.225276:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1042044200/0x27274ba5bb951d6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27274ba5bb951d67 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265165.225288:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1042044200/0x27274ba5bb951d6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb951d67 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265165.225299:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1042044200, rc 0) 00000100:00100000:2.0:1789265165.225346:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a100881dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+12:7616:x1876180414249088:12345-0@lo:101: Request processed in 130us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265165.225353:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789265165.225434:0:7616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:7616:1876180414249088:0@lo:101: 00010000:00010000:0.0:1789265165.225448:0:7616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff8a101b596400/0x27274ba5bb951d67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x27274ba5bb951d6e expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265165.225458:0:7616:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff8a101b596400/0x27274ba5bb951d67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x27274ba5bb951d6e expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265165.225598:0:7616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c078380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:7616:1876180414249216:0@lo:501: 00000100:00100000:0.0:1789265165.225628:0:7616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265165.225658:0:7616:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1002cd7240 going to sleep for 11 seconds 00000100:00100000:2.0:1789265165.225772:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414249216 00000100:00100000:2.0:1789265165.225777:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414249216 00000100:00100000:2.0:1789265165.225810:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789265165.225829:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a100881fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+12:7616:x1876180414249216:12345-0@lo:501: 00000100:00100000:2.0:1789265165.226114:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a100881fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+12:7616:x1876180414249216:12345-0@lo:501: Request processed in 285us (483us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789265165.226122:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789265165.226161:0:7616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c078380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:7616:1876180414249216:0@lo:501: 10000000:01000000:2.0:1789265165.226178:0:7616:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.137@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789265165.226208:0:7616:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.137@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789265165.226214:0:7616:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a101b596400/0x27274ba5bb951d67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x27274ba5bb951d6e expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265165.226223:0:7616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a101b596400/0x27274ba5bb951d67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x27274ba5bb951d6e expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265165.226231:0:7616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.137@tcp lock: ffff8a101b596400/0x27274ba5bb951d67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x27274ba5bb951d6e expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265165.226248:0:7616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789265165.226271:0:7616:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8a103bd8f000 10000000:01000000:2.0:1789265165.226276:0:7616:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789265165.226283:0:7616:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789265165.226285:0:7616:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789265165.226291:0:7616:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1789265165.226294:0:7616:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789265165.226315:0:7616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a1042045a00/0x27274ba5bb951d75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265165.226323:0:7616:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff8a1042045a00/0x27274ba5bb951d75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265165.226343:0:7616:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff8a1042045a00/0x27274ba5bb951d75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265165.226357:0:7616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:7616:1876180414249344:0@lo:101: 00000100:00100000:2.0:1789265165.226386:0:7616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265165.226407:0:7616:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1037ebd540 going to sleep for 11 seconds 00000100:00100000:2.0:1789265165.226423:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414249344 00000100:00100000:2.0:1789265165.226427:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414249344 00000100:00100000:2.0:1789265165.226445:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789265165.226450:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a100881cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+12:7616:x1876180414249344:12345-0@lo:101: 00010000:00010000:2.0:1789265165.226458:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265165.226555:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1042044000/0x27274ba5bb951d7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x27274ba5bb951d75 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265165.226574:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1042044000/0x27274ba5bb951d7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27274ba5bb951d75 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265165.226583:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1042044000/0x27274ba5bb951d7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb951d75 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265165.226591:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1042044000, rc 0) 00000100:00100000:2.0:1789265165.226620:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a100881cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+13:7616:x1876180414249344:12345-0@lo:101: Request processed in 169us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265165.226626:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789265165.226660:0:7616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:7616:1876180414249344:0@lo:101: 00010000:00010000:2.0:1789265165.226671:0:7616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff8a1042045a00/0x27274ba5bb951d75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951d7c expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265165.226693:0:7616:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff8a1042045a00/0x27274ba5bb951d75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x27274ba5bb951d7c expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265165.226761:0:7616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:7616:1876180414249472:0@lo:501: 00000100:00100000:2.0:1789265165.226788:0:7616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265165.226801:0:7616:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1037ebd540 going to sleep for 11 seconds 00000100:00100000:2.0:1789265165.226814:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414249472 00000100:00100000:2.0:1789265165.226818:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414249472 00000100:00100000:2.0:1789265165.226835:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789265165.226841:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a100881f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+13:7616:x1876180414249472:12345-0@lo:501: 00000100:00100000:2.0:1789265165.227013:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a100881f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+13:7616:x1876180414249472:12345-0@lo:501: Request processed in 171us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265165.227020:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789265165.227111:0:7616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:7616:1876180414249472:0@lo:501: 00000100:00100000:2.0:1789265165.227140:0:7616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:7616:1876180414249600:0@lo:503: 00000100:00100000:2.0:1789265165.227181:0:7616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265165.227202:0:7616:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1037ebd540 going to sleep for 11 seconds 00000100:00100000:2.0:1789265165.227215:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414249600 00000100:00100000:2.0:1789265165.227218:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414249600 00000100:00100000:2.0:1789265165.227236:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789265165.227241:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a100881e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+13:7616:x1876180414249600:12345-0@lo:503: 00000100:00100000:2.0:1789265165.227399:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a100881e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+13:7616:x1876180414249600:12345-0@lo:503: Request processed in 156us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265165.227406:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789265165.227444:0:7616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:7616:1876180414249600:0@lo:503: 00010000:00010000:1.0:1789265165.227710:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265165.227719:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff8a101b596400/0x27274ba5bb951d67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x27274ba5bb951d6e expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265165.227729:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b596400 already unused, calling callback (ffffffffc1ba2c20) 10000000:00010000:1.0:1789265165.227740:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff8a101b596400/0x27274ba5bb951d67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x27274ba5bb951d6e expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265165.227750:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff8a101b596400/0x27274ba5bb951d67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x27274ba5bb951d6e expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265165.227758:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff8a101b596400/0x27274ba5bb951d67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x27274ba5bb951d6e expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265165.227765:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789265165.227791:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff8a101b596400/0x27274ba5bb951d67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x27274ba5bb951d6e expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265165.227797:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789265165.227854:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:871daf34-1206-40e7-bd71-78303abe4d37:3317:1876180414249728:0@lo:103: 00000100:00100000:0.0:1789265165.227901:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1789265165.228325:0:7616:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789265165.228402:0:7616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:7616:1876180414249856:0@lo:502: 00000100:00100000:2.0:1789265165.228447:0:7616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789265165.228613:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff8a101b596400/0x27274ba5bb951d67 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x27274ba5bb951d6e expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265165.228622:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff8a101b596400/0x27274ba5bb951d67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x27274ba5bb951d6e expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265165.228640:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265165.228642:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265165.228643:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265165.228682:0:7616:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1037ebd540 going to sleep for 11 seconds 00000100:00100000:3.0:1789265165.228761:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414249856 00000100:00100000:3.0:1789265165.228768:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414249856 00000100:00100000:3.0:1789265165.228819:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789265165.228829:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a100881a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+13:7616:x1876180414249856:12345-0@lo:502: 00000100:00100000:3.0:1789265165.229052:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a100881a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+13:7616:x1876180414249856:12345-0@lo:502: Request processed in 225us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265165.229060:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789265165.229240:0:7616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:7616:1876180414249856:0@lo:502: 00000040:00080000:1.0:1789265165.229535:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1789265165.229593:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1789265165.229629:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1789265165.229681:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1789265165.229721:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1789265165.229758:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1789265165.229794:0:7616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:7616:1876180414249984:0@lo:502: 00000100:00100000:1.0:1789265165.229851:0:7616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265165.229891:0:7616:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103bec2840 going to sleep for 11 seconds 00000100:00100000:1.0:1789265165.229912:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414249984 00000100:00100000:1.0:1789265165.229918:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414249984 00000100:00100000:1.0:1789265165.229951:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789265165.229958:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a100881b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+13:7616:x1876180414249984:12345-0@lo:502: 00000100:00100000:1.0:1789265165.230156:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a100881b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+13:7616:x1876180414249984:12345-0@lo:502: Request processed in 198us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265165.230164:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789265165.230211:0:7616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:7616:1876180414249984:0@lo:502: 00000040:00080000:1.0:1789265165.230308:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1789265165.230318:0:7616:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000100:00100000:0.0:1789265165.231104:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414249728 00000100:00100000:0.0:1789265165.231114:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414249728 00000100:00100000:0.0:1789265165.231162:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789265165.231172:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c07aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:871daf34-1206-40e7-bd71-78303abe4d37+13:3317:x1876180414249728:12345-0@lo:103: 00010000:00010000:0.0:1789265165.231186:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265165.231210:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1042044200/0x27274ba5bb951d6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x27274ba5bb951d67 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265165.231233:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265165.231299:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c07aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:871daf34-1206-40e7-bd71-78303abe4d37+12:3317:x1876180414249728:12345-0@lo:103: Request processed in 129us (3396us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265165.231306:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789265165.231442:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:871daf34-1206-40e7-bd71-78303abe4d37:3317:1876180414249728:0@lo:103: 00000020:01000000:3.0:1789265165.231681:0:7624:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789265165.231691:0:7624:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1789265165.231698:0:7624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265165.231702:0:7624:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1789265165.231708:0:7624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789265165.231726:0:7624:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8a100878b370) 00000020:00000080:3.0:1789265165.231753:0:7624:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789265165.231761:0:7624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789265165.231855:0:7624:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a103bd8f000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1789265165.231865:0:7624:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789265165.231874:0:7624:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x27274ba5bb951d8a 00010000:00010000:3.0:1789265165.237377:0:7624:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1789265165.237990:0:7624:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1789265165.241462:0:7624:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1789265165.241857:0:7624:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1789265165.245867:0:7624:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1789265165.248639:0:7624:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1789265165.251921:0:7624:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1789265165.251940:0:7624:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265165.251948:0:7624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265165.251950:0:7624:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1789265165.251954:0:7624:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789265165.251959:0:7624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265165.251961:0:7624:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789265165.251964:0:7624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789265165.251966:0:7624:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789265165.252060:0:7624:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265165.252065:0:7624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265165.252067:0:7624:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789265165.252071:0:7624:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1789265165.253947:0:7616:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1789265165.254001:0:7616:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789265165.254030:0:7616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a1042045a00/0x27274ba5bb951d75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951d7c expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265165.254055:0:7616:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff8a1042045a00/0x27274ba5bb951d75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951d7c expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265165.254065:0:7616:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a103bd8f000 from 1 10000000:01000000:1.0:1789265165.254069:0:7616:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789265165.254139:0:7616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a101b596400/0x27274ba5bb951d91 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265165.254150:0:7616:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff8a101b596400/0x27274ba5bb951d91 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265165.254165:0:7616:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff8a101b596400/0x27274ba5bb951d91 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265165.254217:0:7616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:7616:1876180414250112:0@lo:101: 00000100:00100000:1.0:1789265165.254318:0:7616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265165.254374:0:7616:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103bec2840 going to sleep for 11 seconds 00000100:00100000:2.0:1789265165.254403:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414250112 00000100:00100000:2.0:1789265165.254414:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414250112 00000100:00100000:2.0:1789265165.254531:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789265165.254544:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008818450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+12:7616:x1876180414250112:12345-0@lo:101: 00010000:00010000:2.0:1789265165.254563:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265165.254579:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1042045800/0x27274ba5bb951d98 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x27274ba5bb951d91 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265165.254629:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1042045800/0x27274ba5bb951d98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27274ba5bb951d91 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265165.254642:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1042045800/0x27274ba5bb951d98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb951d91 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265165.254653:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1042045800, rc 0) 00000100:00100000:2.0:1789265165.254718:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008818450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+13:7616:x1876180414250112:12345-0@lo:101: Request processed in 177us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265165.254726:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789265165.254812:0:7616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:7616:1876180414250112:0@lo:101: 00010000:00010000:1.0:1789265165.254830:0:7616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff8a101b596400/0x27274ba5bb951d91 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951d98 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265165.254841:0:7616:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff8a101b596400/0x27274ba5bb951d91 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x27274ba5bb951d98 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265165.254978:0:7616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:7616:1876180414250240:0@lo:501: 00000100:00100000:1.0:1789265165.255014:0:7616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265165.255053:0:7616:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103bec2840 going to sleep for 11 seconds 00000100:00100000:3.0:1789265165.255142:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414250240 00000100:00100000:3.0:1789265165.255149:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414250240 00000100:00100000:3.0:1789265165.255187:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789265165.255196:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a100881b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+13:7616:x1876180414250240:12345-0@lo:501: 00000100:00100000:3.0:1789265165.255727:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a100881b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+13:7616:x1876180414250240:12345-0@lo:501: Request processed in 530us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265165.255737:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789265165.255786:0:7616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:7616:1876180414250240:0@lo:501: 00000100:00100000:3.0:1789265165.255831:0:7616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10088e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:7616:1876180414250368:0@lo:503: 00000100:00100000:3.0:1789265165.255881:0:7616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265165.255907:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414250368 00000100:00100000:3.0:1789265165.255912:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414250368 00000100:00100000:3.0:1789265165.255935:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789265165.255943:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008819450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+13:7616:x1876180414250368:12345-0@lo:503: 00000100:00100000:3.0:1789265165.257944:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008819450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+13:7616:x1876180414250368:12345-0@lo:503: Request processed in 1991us (2051us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265165.257973:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789265165.258091:0:7616:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1008f93540 going to sleep for 11 seconds 00000100:00100000:3.0:1789265165.258123:0:7616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10088e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:7616:1876180414250368:0@lo:503: 00000040:00080000:3.0:1789265165.260226:0:7616:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789265165.260432:0:7616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10088e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:7616:1876180414250496:0@lo:502: 00000100:00100000:3.0:1789265165.260651:0:7616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265165.260713:0:7616:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1004df9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789265165.260787:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414250496 00000100:00100000:0.0:1789265165.260797:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414250496 00000100:00100000:0.0:1789265165.260891:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789265165.260904:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008819c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+13:7616:x1876180414250496:12345-0@lo:502: 00000100:00100000:0.0:1789265165.261271:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008819c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+13:7616:x1876180414250496:12345-0@lo:502: Request processed in 369us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265165.261280:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789265165.261619:0:7616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10088e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:7616:1876180414250496:0@lo:502: 00000040:00080000:2.0:1789265165.261982:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1789265165.262057:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1789265165.262122:0:7616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:7616:1876180414250624:0@lo:502: 00000100:00100000:2.0:1789265165.262184:0:7616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265165.262215:0:7616:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1037ebd540 going to sleep for 11 seconds 00000100:00100000:3.0:1789265165.262285:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414250624 00000100:00100000:3.0:1789265165.262292:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414250624 00000100:00100000:3.0:1789265165.262343:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789265165.262353:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a100881bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+13:7616:x1876180414250624:12345-0@lo:502: 00000100:00100000:3.0:1789265165.262628:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a100881bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+13:7616:x1876180414250624:12345-0@lo:502: Request processed in 276us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265165.262636:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789265165.262686:0:7616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:7616:1876180414250624:0@lo:502: 00000040:00080000:2.0:1789265165.262780:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1789265165.262791:0:7616:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1789265165.263419:0:7628:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789265165.263430:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265165.263433:0:7628:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789265165.263439:0:7628:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a103bd8f000 00000020:00000080:2.0:1789265165.263442:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789265165.263458:0:7628:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265165.263460:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265165.263462:0:7628:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789265165.263573:0:7628:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1789265165.263706:0:7616:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789265165.263730:0:7616:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789265165.263775:0:7616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a101b596400/0x27274ba5bb951d91 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951d98 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265165.263787:0:7616:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff8a101b596400/0x27274ba5bb951d91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951d98 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265165.263838:0:7616:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789265165.263842:0:7616:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8a103bd8f000 10000000:01000000:3.0:1789265165.263845:0:7616:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8a103bd8f000 10000000:01000000:3.0:1789265165.263850:0:7616:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789265165.263856:0:7616:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a103bd8f000 from 1 10000000:01000000:3.0:1789265165.263865:0:7616:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789265165.263902:0:7616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a10421eaa00/0x27274ba5bb951d9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265165.263912:0:7616:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff8a10421eaa00/0x27274ba5bb951d9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265165.263923:0:7616:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff8a10421eaa00/0x27274ba5bb951d9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265165.263944:0:7616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10088e5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:7616:1876180414250752:0@lo:101: 00000100:00100000:3.0:1789265165.264003:0:7616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265165.264049:0:7616:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1016da20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265165.264103:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414250752 00000100:00100000:0.0:1789265165.264111:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414250752 00000100:00100000:3.0:1789265165.264178:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789265165.264188:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008818c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+13:7616:x1876180414250752:12345-0@lo:101: 00010000:00010000:3.0:1789265165.264200:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265165.264213:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a10421eb600/0x27274ba5bb951da6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x27274ba5bb951d9f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265165.264240:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a10421eb600/0x27274ba5bb951da6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27274ba5bb951d9f expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265165.264251:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a10421eb600/0x27274ba5bb951da6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb951d9f expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265165.264260:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a10421eb600, rc 0) 00000100:00100000:3.0:1789265165.264299:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008818c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+14:7616:x1876180414250752:12345-0@lo:101: Request processed in 113us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265165.264306:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789265165.264325:0:7616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10088e5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:7616:1876180414250752:0@lo:101: 00010000:00010000:0.0:1789265165.264389:0:7616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff8a10421eaa00/0x27274ba5bb951d9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951da6 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265165.264400:0:7616:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff8a10421eaa00/0x27274ba5bb951d9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x27274ba5bb951da6 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265165.264489:0:7616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c078000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:7616:1876180414250880:0@lo:501: 00000100:00100000:0.0:1789265165.264514:0:7616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265165.264591:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414250880 00000100:00100000:0.0:1789265165.264594:0:7616:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1032c89780 going to sleep for 11 seconds 00000100:00100000:3.0:1789265165.264602:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414250880 00000100:00100000:3.0:1789265165.264639:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789265165.264647:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a100881b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+14:7616:x1876180414250880:12345-0@lo:501: 00000100:00100000:3.0:1789265165.264936:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a100881b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+14:7616:x1876180414250880:12345-0@lo:501: Request processed in 289us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265165.264945:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789265165.264971:0:7616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c078000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:7616:1876180414250880:0@lo:501: 00000100:00100000:0.0:1789265165.265002:0:7616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c078000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:7616:1876180414251008:0@lo:503: 00000100:00100000:0.0:1789265165.265053:0:7616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265165.265116:0:7616:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1032c89780 going to sleep for 11 seconds 00000100:00100000:2.0:1789265165.265169:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414251008 00000100:00100000:2.0:1789265165.265175:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414251008 00000100:00100000:2.0:1789265165.265205:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789265165.265211:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a100881a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+14:7616:x1876180414251008:12345-0@lo:503: 00000100:00100000:2.0:1789265165.265446:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a100881a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+14:7616:x1876180414251008:12345-0@lo:503: Request processed in 234us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265165.265453:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789265165.265563:0:7616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c078000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:7616:1876180414251008:0@lo:503: 00000040:00080000:0.0:1789265165.265901:0:7616:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789265165.265979:0:7616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c078000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:7616:1876180414251136:0@lo:502: 00000100:00100000:0.0:1789265165.266023:0:7616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265165.266070:0:7616:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1032c89780 going to sleep for 11 seconds 00000100:00100000:2.0:1789265165.266124:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414251136 00000100:00100000:2.0:1789265165.266130:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414251136 00000100:00100000:2.0:1789265165.266165:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789265165.266174:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008819850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+14:7616:x1876180414251136:12345-0@lo:502: 00000100:00100000:2.0:1789265165.267446:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008819850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+14:7616:x1876180414251136:12345-0@lo:502: Request processed in 1265us (1414us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265165.267459:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789265165.267540:0:7616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c078000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:7616:1876180414251136:0@lo:502: 00000040:00080000:0.0:1789265165.267873:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1789265165.267924:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1789265165.267951:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1789265165.267988:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1789265165.268019:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1789265165.268071:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1789265165.268129:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1789265165.268157:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1789265165.268197:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1789265165.268225:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1789265165.268251:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1789265165.268287:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1789265165.268326:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1789265165.268366:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1789265165.268405:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1789265165.268448:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1789265165.268475:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1789265165.268518:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1789265165.268547:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1789265165.268574:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1789265165.268610:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1789265165.268639:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1789265165.268666:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1789265165.268702:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1789265165.268731:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1789265165.268758:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1789265165.268812:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1789265165.268849:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:0.0:1789265165.268876:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1789265165.268916:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:0.0:1789265165.268955:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:0.0:1789265165.268997:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:0.0:1789265165.269025:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:0.0:1789265165.269124:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:0.0:1789265165.269169:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:0.0:1789265165.269215:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:0.0:1789265165.269249:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:0.0:1789265165.269303:0:7616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c078000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:7616:1876180414251264:0@lo:502: 00000100:00100000:0.0:1789265165.269387:0:7616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265165.269431:0:7616:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1032c89780 going to sleep for 11 seconds 00000100:00100000:3.0:1789265165.269672:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414251264 00000100:00100000:3.0:1789265165.269681:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414251264 00000100:00100000:3.0:1789265165.269749:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789265165.269760:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008818050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+14:7616:x1876180414251264:12345-0@lo:502: 00000100:00100000:3.0:1789265165.270029:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008818050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+14:7616:x1876180414251264:12345-0@lo:502: Request processed in 270us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265165.270048:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789265165.272224:0:7616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c078000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:7616:1876180414251264:0@lo:502: 00000040:00080000:0.0:1789265165.272475:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:0.0:1789265165.272552:0:7616:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1789265165.273679:0:7629:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1789265165.273712:0:7629:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8a1037ec99b8) 00000020:00000080:0.0:1789265165.273739:0:7629:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:0.0:1789265165.273838:0:7629:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a103bd8f000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789265165.273842:0:7629:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a103bd8f000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789265165.273846:0:7629:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a103bd8f000 3 00010000:00080000:0.0:1789265165.273881:0:7629:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a0f029e6800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.137@tcp at head 00010000:00010000:1.0:1789265165.278669:0:7629:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:1.0:1789265165.279156:0:7629:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1789265165.279214:0:7629:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789265165.279232:0:7629:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x27274ba5bb951db4 00000100:00080000:1.0:1789265165.279247:0:7629:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789265165.279254:0:7629:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a0f029e6800 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:1.0:1789265165.279300:0:7629:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a103c0d6680 x1876180414251392/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789265165.279399:0:7629:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789265165.279548:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3314:1876180414251392:0@lo:38: 00000100:00100000:2.0:1789265165.279637:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265165.279820:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876180414251520:0@lo:400: 00000100:00100000:2.0:1789265165.279850:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265165.280197:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1876180414251648:0@lo:400: 00000100:00100000:2.0:1789265165.280227:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265165.280374:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414251392 00000100:00100000:1.0:1789265165.280384:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414251392 00000100:00100000:1.0:1789265165.280417:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414251520 00000100:00100000:1.0:1789265165.280420:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414251520 00000100:00100000:1.0:1789265165.280459:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789265165.280469:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c0d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876180414251520:12345-0@lo:400: 00000100:00100000:1.0:1789265165.280544:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c0d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876180414251520:12345-0@lo:400: Request processed in 76us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265165.280552:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789265165.280570:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789265165.280575:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c0d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3314:x1876180414251392:12345-0@lo:38: 00010000:00080000:1.0:1789265165.280599:0:5840:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 211 last 0 00000020:00000080:1.0:1789265165.280638:0:5840:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x27274ba5bb951dbb 00000004:00100000:1.0:1789265165.280656:0:5840:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789265165.280690:0:5840:0:(import.c:65:import_set_state_nolock()) ffff8a103fbdb000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789265165.280727:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c0d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876180414251392:12345-0@lo:38: Request processed in 151us (1090us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265165.280734:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789265165.281005:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789265165.281014:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414251776:0@lo:400: 00000100:00100000:2.0:1789265165.281055:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265165.281147:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414251648 00000100:00100000:3.0:1789265165.281154:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414251648 00000100:00100000:1.0:1789265165.281235:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789265165.281244:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c0d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876180414251648:12345-0@lo:400: 00000100:00100000:1.0:1789265165.281283:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c0d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876180414251648:12345-0@lo:400: Request processed in 42us (1056us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265165.281289:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789265165.281413:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414251776 00000100:00100000:2.0:1789265165.281418:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414251776 00000100:00100000:2.0:1789265165.281460:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789265165.281535:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c0d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414251776:12345-0@lo:400: 00000100:00100000:2.0:1789265165.281575:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c0d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414251776:12345-0@lo:400: Request processed in 101us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265165.281581:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1789265165.281602:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789265165.281607:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789265165.281642:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a103c0d3b80 x1876180414251520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265165.281660:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876180414251520:0@lo:400: 00010000:00080000:2.0:1789265165.282055:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a103c0d6680 x1876180414251392/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789265175 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265165.282066:0:3314:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789265165.282103:0:3314:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1789265165.282113:0:3314:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789265165.282119:0:3314:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789265165.282122:0:3314:0:(import.c:65:import_set_state_nolock()) ffff8a0f029e6800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789265165.282130:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3314:1876180414251392:0@lo:38: 00010000:00080000:2.0:1789265165.282161:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a103c0d1500 x1876180414251776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265165.282172:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414251776:0@lo:400: 00010000:00080000:2.0:1789265165.282183:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a103c0d1880 x1876180414251648/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265165.282192:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1876180414251648:0@lo:400: 00000040:00080000:2.0:1789265165.282620:0:7629:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:2.0:1789265165.282870:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d1880 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7630:1876180414251904:0@lo:901: 00000100:00100000:2.0:1789265165.282928:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265165.282959:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1004df9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789265165.283139:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414251904 00000100:00100000:3.0:1789265165.283146:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414251904 00000100:00100000:3.0:1789265165.283189:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789265165.283197:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c0d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7630:x1876180414251904:12345-0@lo:901: 00000100:00100000:3.0:1789265165.283654:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c0d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7630:x1876180414251904:12345-0@lo:901: Request processed in 456us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265165.283664:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1789265165.283970:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789265165.284026:0:7630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a103c0d1880 x1876180414251904/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789265181 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265165.284052:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d1880 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7630:1876180414251904:0@lo:901: 00000020:01000000:1.0:1789265165.284247:0:7616:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1789265165.284287:0:7616:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789265165.284399:0:7616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a10421eaa00/0x27274ba5bb951d9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951da6 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265165.284411:0:7616:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff8a10421eaa00/0x27274ba5bb951d9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951da6 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789265165.284488:0:7616:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789265165.284491:0:7616:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789265165.284492:0:7616:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789265165.284493:0:7616:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789265165.284495:0:7616:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789265165.284496:0:7616:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789265165.284498:0:7616:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789265165.284500:0:7616:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789265165.284501:0:7616:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789265165.284503:0:7616:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789265165.284504:0:7616:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789265165.284508:0:7616:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1789265165.284511:0:7616:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789265165.284512:0:7616:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789265165.284513:0:7616:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789265165.284514:0:7616:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789265165.284516:0:7616:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789265165.284517:0:7616:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789265165.284518:0:7616:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789265165.284518:0:7616:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789265165.284519:0:7616:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789265165.284520:0:7616:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789265165.284521:0:7616:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789265165.284546:0:7616:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789265165.284562:0:7616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:7616:1876180414252032:0@lo:253: 00000100:00100000:1.0:1789265165.284621:0:7616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265165.284659:0:7616:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103bec20c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265165.284991:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414252032 00000100:00100000:2.0:1789265165.284998:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414252032 00000100:00100000:2.0:1789265165.285061:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789265165.285071:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a100881a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+14:7616:x1876180414252032:12345-0@lo:253: 20000000:01000000:2.0:1789265165.285132:0:5834:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789265165.285150:0:5834:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789265165.304705:0:5834:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789265165.304759:0:5834:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1789265165.304798:0:5856:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789265165.304805:0:5856:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789265165.304833:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a1017263800/0x27274ba5bb951dc2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265165.304855:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1042045200/0x27274ba5bb951d13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb951d0c expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265165.304864:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a1017263800/0x27274ba5bb951dc2 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265165.304923:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1042045200/0x27274ba5bb951d13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27274ba5bb951d0c expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265165.304943:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a1042045200/0x27274ba5bb951d13 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27274ba5bb951d0c expref: 14 pid: 5834 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265165.304960:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c078000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5856:1876180414252160:0@lo:104: 00000100:00100000:0.0:1789265165.305061:0:5856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265165.305174:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10202c2180 going to sleep for 11 seconds 00000100:00100000:2.0:1789265165.305218:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414252160 00000100:00100000:2.0:1789265165.305228:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414252160 00000100:00100000:2.0:1789265165.305394:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789265165.305406:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c079500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:871daf34-1206-40e7-bd71-78303abe4d37+3:5856:x1876180414252160:12345-0@lo:104: 00010000:00010000:2.0:1789265165.305421:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff8a1017262e00/0x27274ba5bb951d0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27274ba5bb951d13 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265165.305615:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789265165.305624:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c079500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:871daf34-1206-40e7-bd71-78303abe4d37+3:5856:x1876180414252160:12345-0@lo:104: Request processed in 220us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265165.305631:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1789265165.305678:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265165.305686:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff8a1017262e00/0x27274ba5bb951d0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27274ba5bb951d13 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265165.305695:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1017262e00 already unused, calling callback (ffffffffc1ba2c20) 10000000:00010000:0.0:1789265165.305717:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff8a1017262e00/0x27274ba5bb951d0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x27274ba5bb951d13 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265165.305727:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff8a1017262e00/0x27274ba5bb951d0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x27274ba5bb951d13 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789265165.305735:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff8a1017262e00/0x27274ba5bb951d0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x27274ba5bb951d13 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265165.305741:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789265165.305812:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff8a1017262e00/0x27274ba5bb951d0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951d13 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265165.305815:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c078000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5856:1876180414252160:0@lo:104: 00010000:00010000:0.0:1789265165.305819:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789265165.305840:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a1017263800/0x27274ba5bb951dc2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265165.305840:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff8a1017262e00/0x27274ba5bb951d0c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951d13 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265165.305847:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff8a1017262e00/0x27274ba5bb951d0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951d13 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265165.305867:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265165.305869:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265165.305870:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265165.305906:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c079c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:871daf34-1206-40e7-bd71-78303abe4d37:3317:1876180414252288:0@lo:103: 00000100:00100000:2.0:1789265165.306165:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265165.306233:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414252288 00000100:00100000:2.0:1789265165.306239:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414252288 00010000:00010000:2.0:1789265165.306261:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1042045200/0x27274ba5bb951d13 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27274ba5bb951d0c expref: 15 pid: 5834 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265165.306288:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789265165.306296:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10119df850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:871daf34-1206-40e7-bd71-78303abe4d37+15:3317:x1876180414252288:12345-0@lo:103: 00010000:00010000:2.0:1789265165.306309:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265165.306432:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1042045200/0x27274ba5bb951d13 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27274ba5bb951d0c expref: 15 pid: 5834 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265165.306448:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1042045200/0x27274ba5bb951d13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27274ba5bb951d0c expref: 15 pid: 5834 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265165.306464:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1042045200/0x27274ba5bb951d13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27274ba5bb951d0c expref: 15 pid: 5834 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265165.306547:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a1017263800/0x27274ba5bb951dc2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265165.306557:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1017263800/0x27274ba5bb951dc2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789265165.306574:0:5826:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002067533s 00010000:00010000:2.0:1789265165.306579:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a1017263800/0x27274ba5bb951dc2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265165.306587:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a1017263800/0x27274ba5bb951dc2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265165.306594:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a1017263800/0x27274ba5bb951dc2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265165.306613:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a1017263800/0x27274ba5bb951dc2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265165.306619:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1017263800 already unused, calling callback (ffffffffc1581350) 00010000:00010000:2.0:1789265165.306624:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a1017263800/0x27274ba5bb951dc2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265165.306632:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a1017263800/0x27274ba5bb951dc2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265165.306737:0:5856:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a1017263800/0x27274ba5bb951dc2 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265165.306746:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a1017263800/0x27274ba5bb951dc2 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265165.306777:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a1017263800/0x27274ba5bb951dc2 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265165.306785:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1017263800/0x27274ba5bb951dc2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265165.306800:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265165.306925:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10119df850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:871daf34-1206-40e7-bd71-78303abe4d37+14:3317:x1876180414252288:12345-0@lo:103: Request processed in 629us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265165.306934:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789265165.307027:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c079c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:871daf34-1206-40e7-bd71-78303abe4d37:3317:1876180414252288:0@lo:103: 00000100:00100000:2.0:1789265165.312192:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a100881a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+13:7616:x1876180414252032:12345-0@lo:253: Request processed in 27110us (27557us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265165.312210:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789265165.312352:0:7616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:871daf34-1206-40e7-bd71-78303abe4d37:7616:1876180414252032:0@lo:253: 10000000:01000000:1.0:1789265165.312372:0:7616:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789265165.312376:0:7616:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789265165.312379:0:7616:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789265165.312380:0:7616:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789265165.312381:0:7616:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789265165.312382:0:7616:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789265165.312384:0:7616:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789265165.312404:0:7616:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789265165.312406:0:7616:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789265165.312408:0:7616:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789265165.312410:0:7616:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789265165.312412:0:7616:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789265165.312432:0:7616:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789265165.317658:0:7616:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1789265165.317832:0:7616:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789265165.318972:0:7616:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1789265165.319608:0:7616:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789265165.319807:0:7616:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1789265165.320204:0:7616:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1789265165.321771:0:7616:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1789265165.530833:0:7616:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1789265165.530843:0:7616:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1789265165.530885:0:7616:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789265165.530960:0:7616:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.137@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789265165.530980:0:7616:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1789265165.531018:0:7616:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1789265165.618520:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265166.645686:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265167.154443:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c07b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414252416:0@lo:13: 00000100:00100000:2.0:1789265167.154516:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265167.154625:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414252416 00000100:00100000:0.0:1789265167.154632:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414252416 00000100:00100000:0.0:1789265167.154715:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789265167.154724:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c0d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876180414252416:12345-0@lo:13: 00002000:00000024:0.0:1789265167.154754:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789265167.154800:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c0d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876180414252416:12345-0@lo:13: Request processed in 77us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265167.154807:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789265167.154849:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a103c07b480 x1876180414252416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265183 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265167.154866:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c07b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414252416:0@lo:13: 00000100:00080000:2.0:1789265167.154929:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789265167.672814:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265168.691404:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265169.719589:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265170.740306:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:871daf34-1206-40e7-bd71-78303abe4d37:3315:1876180414252544:0@lo:400: 00000100:00100000:2.0:1789265170.740379:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265170.740454:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414252928:0@lo:400: 00000100:00100000:2.0:1789265170.740476:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1876180414253056:0@lo:400: 00000100:00100000:0.0:1789265170.740485:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265170.740514:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789265170.740517:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265170.740519:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1876180414252800:0@lo:400: 00000100:00100000:2.0:1789265170.740536:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789265170.740539:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265170.740542:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876180414252672:0@lo:400: 00000100:00100000:2.0:1789265170.740562:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789265170.740562:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265170.740573:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414252928 00000100:00100000:0.0:1789265170.740581:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414252928 00000100:00100000:2.0:1789265170.740602:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414253056 00000100:00100000:2.0:1789265170.740605:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414253056 00000100:00100000:2.0:1789265170.740624:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414252800 00000100:00100000:2.0:1789265170.740627:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414252800 00000100:00100000:0.0:1789265170.740629:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789265170.740637:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c07b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1876180414252928:12345-0@lo:400: 00000100:00100000:2.0:1789265170.740638:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414252672 00000100:00100000:2.0:1789265170.740640:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414252672 00000100:00100000:2.0:1789265170.740651:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789265170.740657:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876180414253056:12345-0@lo:400: 00000100:00100000:2.0:1789265170.740687:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876180414253056:12345-0@lo:400: Request processed in 29us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265170.740687:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c07b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1876180414252928:12345-0@lo:400: Request processed in 50us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265170.740695:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789265170.740695:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789265170.740710:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789265170.740715:0:5842:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789265170.740716:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c07ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1876180414252800:12345-0@lo:400: 00000100:00100000:0.0:1789265170.740722:0:5842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00080000:0.0:1789265170.740735:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789265170.740739:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789265170.740743:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c07ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1876180414252800:12345-0@lo:400: Request processed in 28us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265170.740749:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789265170.740761:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789265170.740765:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876180414252672:12345-0@lo:400: 00000100:00100000:2.0:1789265170.740790:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876180414252672:12345-0@lo:400: Request processed in 24us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265170.740796:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1789265170.740846:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a103c0d3800 x1876180414252672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265186 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265170.740944:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876180414252672:0@lo:400: 00010000:00080000:2.0:1789265170.740959:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a103c0d0380 x1876180414253056/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265186 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265170.740966:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1876180414253056:0@lo:400: 00010000:00080000:0.0:1789265170.740989:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a103c0d0a80 x1876180414252800/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265186 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265170.741016:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1876180414252800:0@lo:400: 00010000:00080000:0.0:1789265170.741028:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a103c0d1c00 x1876180414252928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265186 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265170.741036:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414252928:0@lo:400: 00000100:00100000:1.0:1789265170.741428:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414252544 00000100:00100000:1.0:1789265170.741434:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414252544 00000100:00100000:1.0:1789265170.741502:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789265170.741510:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008818850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+13:3315:x1876180414252544:12345-0@lo:400: 00000100:00100000:1.0:1789265170.741549:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008818850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+13:3315:x1876180414252544:12345-0@lo:400: Request processed in 41us (1171us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265170.741556:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789265170.741653:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:871daf34-1206-40e7-bd71-78303abe4d37:3315:1876180414252544:0@lo:400: 00000001:02000400:1.0:1789265171.036198:0:7973:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg337-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789265171.763065:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265172.274345:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c07a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414253184:0@lo:13: 00000100:00100000:2.0:1789265172.274739:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265172.274887:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414253184 00000100:00100000:0.0:1789265172.274897:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414253184 00000100:00100000:0.0:1789265172.274963:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789265172.274973:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414253184:12345-0@lo:13: 00002000:00000024:0.0:1789265172.275014:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789265172.275059:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414253184:12345-0@lo:13: Request processed in 87us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265172.275066:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1789265172.275272:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789265172.275298:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a103c07a300 x1876180414253184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265188 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265172.275376:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c07a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414253184:0@lo:13: 00010000:00010000:0.0:1789265172.787306:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789265173.298266:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789265173.298274:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a103c151000 from 30 10000000:01000000:2.0:1789265173.298281:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789265173.298329:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a1042045c00/0x27274ba5bb951dc9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265173.298342:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff8a1042045c00/0x27274ba5bb951dc9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265173.298355:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff8a1042045c00/0x27274ba5bb951dc9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265173.298381:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414253312:0@lo:101: 00000100:00100000:2.0:1789265173.298452:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265173.298595:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a100914a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265173.301124:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414253312 00000100:00100000:0.0:1789265173.301138:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414253312 00000100:00100000:0.0:1789265173.301273:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789265173.301286:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a100881ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+13:5837:x1876180414253312:12345-0@lo:101: 00010000:00010000:0.0:1789265173.301304:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265173.301323:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1017263a00/0x27274ba5bb951dd0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x27274ba5bb951dc9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265173.301353:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1017263a00/0x27274ba5bb951dd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27274ba5bb951dc9 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265173.301364:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1017263a00/0x27274ba5bb951dd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb951dc9 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265173.301391:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1017263a00, rc 0) 00000100:00100000:0.0:1789265173.301478:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a100881ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+14:5837:x1876180414253312:12345-0@lo:101: Request processed in 195us (3026us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265173.301486:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789265173.301581:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414253312:0@lo:101: 00010000:00010000:3.0:1789265173.301599:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff8a1042045c00/0x27274ba5bb951dc9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951dd0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265173.301609:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff8a1042045c00/0x27274ba5bb951dc9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x27274ba5bb951dd0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265173.301692:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10088e5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414253440:0@lo:501: 00000100:00100000:3.0:1789265173.301729:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265173.302319:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a0f0294c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265173.302411:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414253440 00000100:00100000:2.0:1789265173.302417:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414253440 00000100:00100000:2.0:1789265173.302447:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789265173.302455:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008819050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+14:5837:x1876180414253440:12345-0@lo:501: 00000100:00100000:2.0:1789265173.302834:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008819050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+14:5837:x1876180414253440:12345-0@lo:501: Request processed in 378us (1103us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265173.302841:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789265173.303006:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10088e5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414253440:0@lo:501: 00000100:00100000:3.0:1789265173.303049:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10088e5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414253568:0@lo:503: 00000100:00100000:3.0:1789265173.303121:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265173.303142:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a0f0294c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265173.303369:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414253568 00000100:00100000:0.0:1789265173.303375:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414253568 00000100:00100000:0.0:1789265173.303404:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789265173.303412:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+14:5837:x1876180414253568:12345-0@lo:503: 00000100:00100000:0.0:1789265173.303731:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+14:5837:x1876180414253568:12345-0@lo:503: Request processed in 318us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265173.303739:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789265173.303830:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10088e5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414253568:0@lo:503: 00000100:00100000:3.0:1789265173.304866:0:8077:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10088e5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:8077:1876180414253696:0@lo:502: 00000100:00100000:3.0:1789265173.304940:0:8077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265173.305325:0:8077:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a0f0294c240 going to sleep for 11 seconds 00000100:00100000:1.0:1789265173.305388:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414253696 00000100:00100000:1.0:1789265173.305395:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414253696 00000100:00100000:0.0:1789265173.305453:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789265173.305464:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+14:8077:x1876180414253696:12345-0@lo:502: 00000100:00100000:0.0:1789265173.305816:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+14:8077:x1876180414253696:12345-0@lo:502: Request processed in 354us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265173.305825:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789265173.306151:0:8077:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10088e5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:8077:1876180414253696:0@lo:502: 00000100:00100000:3.0:1789265173.306213:0:8077:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10088e5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:8077:1876180414253824:0@lo:502: 00000100:00100000:3.0:1789265173.306250:0:8077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265173.306370:0:8077:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a0f0294c240 going to sleep for 11 seconds 00000100:00100000:2.0:1789265173.306447:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414253824 00000100:00100000:2.0:1789265173.306453:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414253824 00000100:00100000:2.0:1789265173.306478:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789265173.306485:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+14:8077:x1876180414253824:12345-0@lo:502: 00000100:00100000:2.0:1789265173.306664:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+14:8077:x1876180414253824:12345-0@lo:502: Request processed in 178us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265173.306671:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789265173.306746:0:8077:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10088e5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:8077:1876180414253824:0@lo:502: 00000040:00080000:3.0:1789265173.306766:0:8077:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1789265173.307057:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1789265173.307099:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789265173.307109:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a1042045c00/0x27274ba5bb951dc9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951dd0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265173.307119:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff8a1042045c00/0x27274ba5bb951dc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951dd0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265173.307128:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1789265173.307131:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1789265173.307134:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789265173.307159:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a1042045200/0x27274ba5bb951dd7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265173.307178:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff8a1042045200/0x27274ba5bb951dd7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265173.307189:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff8a1042045200/0x27274ba5bb951dd7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265173.307202:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414253952:0@lo:101: 00000100:00100000:2.0:1789265173.307234:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265173.307253:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a100914a780 going to sleep for 11 seconds 00000100:00100000:3.0:1789265173.307329:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414253952 00000100:00100000:3.0:1789265173.307334:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414253952 00000100:00100000:3.0:1789265173.307354:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789265173.307360:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+14:5837:x1876180414253952:12345-0@lo:101: 00010000:00010000:3.0:1789265173.307370:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265173.307381:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a10421ea400/0x27274ba5bb951dde lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x27274ba5bb951dd7 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265173.307402:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a10421ea400/0x27274ba5bb951dde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27274ba5bb951dd7 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265173.307412:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a10421ea400/0x27274ba5bb951dde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb951dd7 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265173.307421:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a10421ea400, rc 0) 00000100:00100000:3.0:1789265173.307449:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+15:5837:x1876180414253952:12345-0@lo:101: Request processed in 89us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265173.307454:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789265173.307530:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414253952:0@lo:101: 00010000:00010000:2.0:1789265173.307542:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff8a1042045200/0x27274ba5bb951dd7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951dde expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265173.307551:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff8a1042045200/0x27274ba5bb951dd7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x27274ba5bb951dde expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265173.307592:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414254080:0@lo:501: 00000100:00100000:2.0:1789265173.307629:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265173.307653:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a100914a780 going to sleep for 11 seconds 00000100:00100000:3.0:1789265173.307698:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414254080 00000100:00100000:3.0:1789265173.307702:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414254080 00000100:00100000:3.0:1789265173.307720:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789265173.307726:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+15:5837:x1876180414254080:12345-0@lo:501: 00000100:00100000:3.0:1789265173.307960:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+15:5837:x1876180414254080:12345-0@lo:501: Request processed in 233us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265173.307973:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789265173.308215:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414254080:0@lo:501: 00000100:00100000:2.0:1789265173.308241:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414254208:0@lo:503: 00000100:00100000:2.0:1789265173.308277:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265173.308299:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a100914a780 going to sleep for 11 seconds 00000100:00100000:3.0:1789265173.308367:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414254208 00000100:00100000:3.0:1789265173.308372:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414254208 00000100:00100000:3.0:1789265173.308392:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789265173.308397:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+15:5837:x1876180414254208:12345-0@lo:503: 00000100:00100000:3.0:1789265173.308685:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+15:5837:x1876180414254208:12345-0@lo:503: Request processed in 287us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265173.308692:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789265173.308918:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414254208:0@lo:503: 00000100:00100000:2.0:1789265173.309504:0:8078:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:8078:1876180414254336:0@lo:502: 00000100:00100000:2.0:1789265173.309559:0:8078:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265173.309594:0:8078:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a100914acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265173.309643:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414254336 00000100:00100000:3.0:1789265173.309648:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414254336 00000100:00100000:3.0:1789265173.309672:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789265173.309679:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+15:8078:x1876180414254336:12345-0@lo:502: 00000100:00100000:3.0:1789265173.309947:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+15:8078:x1876180414254336:12345-0@lo:502: Request processed in 268us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265173.309955:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789265173.311289:0:8078:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:8078:1876180414254336:0@lo:502: 00000020:01000000:2.0:1789265173.311332:0:8078:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789265173.311344:0:8078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265173.311346:0:8078:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789265173.311351:0:8078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789265173.311353:0:8078:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789265173.311380:0:8078:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:8078:1876180414254464:0@lo:502: 00000100:00100000:2.0:1789265173.311438:0:8078:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265173.311549:0:8078:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a100914acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265173.311732:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414254464 00000100:00100000:3.0:1789265173.311739:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414254464 00000100:00100000:3.0:1789265173.311820:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789265173.311829:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+15:8078:x1876180414254464:12345-0@lo:502: 00000100:00100000:3.0:1789265173.312132:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+15:8078:x1876180414254464:12345-0@lo:502: Request processed in 303us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265173.312140:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789265173.312570:0:8078:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:8078:1876180414254464:0@lo:502: 00000020:01000000:2.0:1789265173.312598:0:8078:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265173.312606:0:8078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265173.312608:0:8078:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789265173.312611:0:8078:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:0.0:1789265173.313367:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1789265173.313387:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789265173.313398:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a1042045200/0x27274ba5bb951dd7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951dde expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265173.313409:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff8a1042045200/0x27274ba5bb951dd7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951dde expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265173.313419:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789265173.313421:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a10202ad000 from 30 10000000:01000000:0.0:1789265173.313437:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789265173.313469:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a1017263c00/0x27274ba5bb951de5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265173.313477:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff8a1017263c00/0x27274ba5bb951de5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265173.313486:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff8a1017263c00/0x27274ba5bb951de5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265173.313584:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c07b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414254592:0@lo:101: 00000100:00100000:0.0:1789265173.313634:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265173.313714:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103bb4f900 going to sleep for 11 seconds 00000100:00100000:2.0:1789265173.313922:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414254592 00000100:00100000:2.0:1789265173.313928:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414254592 00000100:00100000:2.0:1789265173.314188:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789265173.314199:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+15:5837:x1876180414254592:12345-0@lo:101: 00010000:00010000:2.0:1789265173.314212:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265173.314226:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1042044200/0x27274ba5bb951dec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x27274ba5bb951de5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265173.314247:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1042044200/0x27274ba5bb951dec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27274ba5bb951de5 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265173.314257:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1042044200/0x27274ba5bb951dec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb951de5 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265173.314279:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1042044200, rc 0) 00000100:00100000:2.0:1789265173.314783:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+16:5837:x1876180414254592:12345-0@lo:101: Request processed in 584us (1146us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265173.314784:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c07b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414254592:0@lo:101: 00000100:00100000:2.0:1789265173.314790:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00010000:00010000:0.0:1789265173.314800:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff8a1017263c00/0x27274ba5bb951de5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951dec expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265173.314808:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff8a1017263c00/0x27274ba5bb951de5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x27274ba5bb951dec expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265173.314860:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c07b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414254720:0@lo:501: 00000100:00100000:0.0:1789265173.314887:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265173.314961:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103bb4f900 going to sleep for 11 seconds 00000100:00100000:3.0:1789265173.315769:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414254720 00000100:00100000:3.0:1789265173.315777:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414254720 00000100:00100000:3.0:1789265173.315827:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789265173.315837:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+16:5837:x1876180414254720:12345-0@lo:501: 00000100:00100000:3.0:1789265173.316227:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+16:5837:x1876180414254720:12345-0@lo:501: Request processed in 391us (1337us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265173.316235:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789265173.316326:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c07b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414254720:0@lo:501: 00000100:00100000:0.0:1789265173.316364:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c07b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414254848:0@lo:503: 00000100:00100000:0.0:1789265173.316407:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265173.316442:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103bb4f900 going to sleep for 11 seconds 00000100:00100000:2.0:1789265173.316497:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414254848 00000100:00100000:2.0:1789265173.316502:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414254848 00000100:00100000:2.0:1789265173.316535:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789265173.316543:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+16:5837:x1876180414254848:12345-0@lo:503: 00000100:00100000:2.0:1789265173.316691:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+16:5837:x1876180414254848:12345-0@lo:503: Request processed in 148us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265173.316698:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789265173.316724:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c07b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414254848:0@lo:503: 00000100:00100000:0.0:1789265173.317744:0:8079:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c07b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:8079:1876180414254976:0@lo:502: 00000100:00100000:0.0:1789265173.317796:0:8079:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265173.317833:0:8079:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103bb4f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265173.317882:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414254976 00000100:00100000:2.0:1789265173.317887:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414254976 00000100:00100000:2.0:1789265173.317926:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789265173.317934:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+16:8079:x1876180414254976:12345-0@lo:502: 00000100:00100000:2.0:1789265173.318187:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+16:8079:x1876180414254976:12345-0@lo:502: Request processed in 253us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265173.318194:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789265173.318349:0:8079:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c07b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:8079:1876180414254976:0@lo:502: 00000100:00100000:3.0:1789265173.318394:0:8079:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10088e5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:8079:1876180414255104:0@lo:502: 00000100:00100000:3.0:1789265173.318429:0:8079:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265173.318457:0:8079:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a0f0294c540 going to sleep for 11 seconds 00000100:00100000:0.0:1789265173.318562:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414255104 00000100:00100000:0.0:1789265173.318567:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414255104 00000100:00100000:0.0:1789265173.318603:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789265173.318610:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+16:8079:x1876180414255104:12345-0@lo:502: 00000100:00100000:0.0:1789265173.318734:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+16:8079:x1876180414255104:12345-0@lo:502: Request processed in 124us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265173.318740:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789265173.318808:0:8079:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10088e5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:8079:1876180414255104:0@lo:502: 00000040:00080000:3.0:1789265173.318829:0:8079:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1789265173.319068:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1789265173.319115:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789265173.319126:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a1017263c00/0x27274ba5bb951de5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951dec expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265173.319136:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff8a1017263c00/0x27274ba5bb951de5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951dec expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265173.319146:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789265173.319148:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a10202ad000 from 5 10000000:01000000:0.0:1789265173.319151:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789265173.319177:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a1017263600/0x27274ba5bb951df3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265173.319185:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff8a1017263600/0x27274ba5bb951df3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265173.319194:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff8a1017263600/0x27274ba5bb951df3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265173.319224:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c07bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414255232:0@lo:101: 00000100:00100000:0.0:1789265173.319257:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265173.319276:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103bb4f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265173.319505:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414255232 00000100:00100000:2.0:1789265173.319511:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414255232 00000100:00100000:2.0:1789265173.319570:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789265173.319577:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+16:5837:x1876180414255232:12345-0@lo:101: 00010000:00010000:2.0:1789265173.319586:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265173.319598:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1042044600/0x27274ba5bb951dfa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27274ba5bb951df3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265173.319640:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1042044600/0x27274ba5bb951dfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27274ba5bb951df3 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265173.319651:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1042044600/0x27274ba5bb951dfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb951df3 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265173.319659:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1042044600, rc 0) 00000100:00100000:2.0:1789265173.319690:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+17:5837:x1876180414255232:12345-0@lo:101: Request processed in 115us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265173.319696:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789265173.319759:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c07bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414255232:0@lo:101: 00010000:00010000:0.0:1789265173.319771:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff8a1017263600/0x27274ba5bb951df3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951dfa expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265173.319780:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff8a1017263600/0x27274ba5bb951df3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27274ba5bb951dfa expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265173.319823:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c07bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414255360:0@lo:256: 00000100:00100000:0.0:1789265173.319852:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265173.320207:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103bb4f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265173.320246:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414255360 00000100:00100000:3.0:1789265173.320251:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414255360 00000100:00100000:3.0:1789265173.320276:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789265173.320282:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+17:5837:x1876180414255360:12345-0@lo:256: 20000000:01000000:3.0:1789265173.320296:0:5833:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789265173.320312:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789265173.320315:0:5833:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1789265173.320399:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+17:5837:x1876180414255360:12345-0@lo:256: Request processed in 116us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265173.320407:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789265173.320488:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c07bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414255360:0@lo:256: 10000000:01000000:0.0:1789265173.320529:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789265173.320536:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a1017263600/0x27274ba5bb951df3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951dfa expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265173.320545:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff8a1017263600/0x27274ba5bb951df3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951dfa expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265173.320552:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789265173.320554:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1789265173.320557:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789265173.320574:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a1017262a00/0x27274ba5bb951e01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265173.320589:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff8a1017262a00/0x27274ba5bb951e01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265173.320597:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff8a1017262a00/0x27274ba5bb951e01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265173.320607:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c07bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414255488:0@lo:101: 00000100:00100000:0.0:1789265173.320628:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265173.320653:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103bb4f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265173.320692:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414255488 00000100:00100000:2.0:1789265173.320696:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414255488 00000100:00100000:2.0:1789265173.320746:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789265173.320752:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+17:5837:x1876180414255488:12345-0@lo:101: 00010000:00010000:2.0:1789265173.320758:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265173.320767:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1042045000/0x27274ba5bb951e08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x27274ba5bb951e01 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265173.320781:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1042045000/0x27274ba5bb951e08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27274ba5bb951e01 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265173.320793:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1042045000/0x27274ba5bb951e08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb951e01 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265173.320800:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1042045000, rc 0) 00000100:00100000:2.0:1789265173.320831:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+18:5837:x1876180414255488:12345-0@lo:101: Request processed in 79us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265173.320837:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789265173.320890:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c07bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414255488:0@lo:101: 00010000:00010000:0.0:1789265173.320899:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff8a1017262a00/0x27274ba5bb951e01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951e08 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265173.320906:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff8a1017262a00/0x27274ba5bb951e01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x27274ba5bb951e08 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265173.320942:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c07bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414255616:0@lo:501: 00000100:00100000:0.0:1789265173.320965:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265173.322837:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414255616 00000100:00100000:3.0:1789265173.322848:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414255616 00000100:00100000:3.0:1789265173.322900:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789265173.322909:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+18:5837:x1876180414255616:12345-0@lo:501: 00000100:00100000:0.0:1789265173.323200:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103bb4f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265173.323884:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+18:5837:x1876180414255616:12345-0@lo:501: Request processed in 975us (2916us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265173.323893:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789265173.323964:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c07bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414255616:0@lo:501: 00000100:00100000:0.0:1789265173.324883:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c07bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414255744:0@lo:503: 00000100:00100000:0.0:1789265173.324945:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265173.325170:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103bb4f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265173.325311:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414255744 00000100:00100000:1.0:1789265173.325319:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414255744 00000100:00100000:1.0:1789265173.325362:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789265173.325371:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+18:5837:x1876180414255744:12345-0@lo:503: 00000100:00100000:1.0:1789265173.325762:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+18:5837:x1876180414255744:12345-0@lo:503: Request processed in 391us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265173.325777:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789265173.325846:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c07bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414255744:0@lo:503: 00000100:00100000:2.0:1789265173.326658:0:8080:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:8080:1876180414255872:0@lo:502: 00000100:00100000:2.0:1789265173.326713:0:8080:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265173.326782:0:8080:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1018bca0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265173.326821:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414255872 00000100:00100000:3.0:1789265173.326827:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414255872 00000100:00100000:3.0:1789265173.326895:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789265173.326905:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+18:8080:x1876180414255872:12345-0@lo:502: 00000100:00100000:3.0:1789265173.327624:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+18:8080:x1876180414255872:12345-0@lo:502: Request processed in 710us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265173.327634:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789265173.328604:0:8080:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:8080:1876180414255872:0@lo:502: 00000020:01000000:0.0:1789265173.328656:0:8080:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789265173.328665:0:8080:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1789265173.328672:0:8080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265173.328674:0:8080:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1789265173.328679:0:8080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789265173.328683:0:8080:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.137@tcp to nid 0x20000c0a8cb89 (192.168.203.137@tcp) 00000020:01000000:0.0:1789265173.328706:0:8080:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789265173.328709:0:8080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789265173.328726:0:8080:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8a1037ec8000) 00000020:00000080:0.0:1789265173.328746:0:8080:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1789265173.328753:0:8080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789265173.329115:0:8080:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1789265173.329121:0:8080:0:(osd_handler.c:1573:osd_obd_connect()) connect #6 00000020:00000080:0.0:1789265173.329129:0:8080:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x27274ba5bb951e16 00010000:00080000:0.0:1789265173.329158:0:8080:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a103fac0800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.137@tcp at head 00010000:00010000:0.0:1789265173.329366:0:8080:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1789265173.329683:0:8080:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1789265173.329696:0:8080:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789265173.330632:0:8080:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789265173.331203:0:8080:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789265173.331254:0:8080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1789265173.331317:0:8080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1789265173.333776:0:8081:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789265173.333782:0:8081:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1789265173.336536:0:8080:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789265173.336550:0:8080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789265173.336584:0:8080:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789265173.336605:0:8080:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x27274ba5bb951e1d 00000100:00080000:2.0:1789265173.336616:0:8080:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789265173.336621:0:8080:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a103fac0800 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:2.0:1789265173.336654:0:8080:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a0f02da1180 x1876180414256000/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789265173.336673:0:8080:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1789265173.336786:0:8080:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265173.336791:0:8080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265173.336793:0:8080:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1789265173.336796:0:8080:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789265173.336800:0:8080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265173.336801:0:8080:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789265173.336804:0:8080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789265173.336806:0:8080:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789265173.336844:0:8080:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:8080:1876180414256128:0@lo:502: 00000100:00100000:2.0:1789265173.336935:0:8080:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265173.336976:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414256128 00000100:00100000:2.0:1789265173.336996:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414256128 00000100:00100000:2.0:1789265173.337035:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789265173.337045:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+18:8080:x1876180414256128:12345-0@lo:502: 00000100:00100000:2.0:1789265173.337298:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+18:8080:x1876180414256128:12345-0@lo:502: Request processed in 254us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265173.337305:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789265173.337360:0:8080:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103cd503c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265173.337383:0:8080:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:8080:1876180414256128:0@lo:502: 00000020:01000000:2.0:1789265173.337408:0:8080:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265173.337413:0:8080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265173.337414:0:8080:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789265173.337417:0:8080:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:2.0:1789265173.337462:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1789265173.337478:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789265173.337487:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a1017262a00/0x27274ba5bb951e01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951e08 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265173.337497:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff8a1017262a00/0x27274ba5bb951e01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951e08 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265173.337506:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789265173.337509:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8a10087899b8 from 1 10000000:01000000:2.0:1789265173.337511:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789265173.337544:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a103fad7600/0x27274ba5bb951e24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265173.337552:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff8a103fad7600/0x27274ba5bb951e24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265173.337562:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff8a103fad7600/0x27274ba5bb951e24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265173.337574:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414256256:0@lo:101: 00000100:00100000:2.0:1789265173.337601:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265173.337614:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103cd503c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265173.337750:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1876180414256000:0@lo:8: 00000100:00100000:0.0:1789265173.337784:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265173.338001:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414256000 00000100:00100000:2.0:1789265173.338013:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414256000 00000100:00100000:2.0:1789265173.338113:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789265173.338119:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c07bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3314:x1876180414256000:12345-0@lo:8: 00010000:00080000:2.0:1789265173.338141:0:6685:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 219 last 0 00000020:00000080:2.0:1789265173.338166:0:6685:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x27274ba5bb951e2b 00002000:00100000:2.0:1789265173.338179:0:6685:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8a0f029e2800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113969 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1789265173.338184:0:6685:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1789265173.338187:0:6685:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1789265173.338293:0:6685:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789265173.338445:0:6685:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789265173.338470:0:6685:0:(import.c:65:import_set_state_nolock()) ffff8a0f029e2000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789265173.338521:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c07bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3314:x1876180414256000:12345-0@lo:8: Request processed in 400us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265173.338529:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789265173.338593:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414256256 00000100:00100000:3.0:1789265173.338598:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414256256 00000100:00100000:3.0:1789265173.338623:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789265173.338630:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+18:5837:x1876180414256256:12345-0@lo:101: 00010000:00010000:3.0:1789265173.338638:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265173.338652:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a10421eac00/0x27274ba5bb951e32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x27274ba5bb951e24 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265173.338671:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a10421eac00/0x27274ba5bb951e32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27274ba5bb951e24 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265173.338682:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a10421eac00/0x27274ba5bb951e32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb951e24 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265173.338690:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a10421eac00, rc 0) 00000100:00100000:3.0:1789265173.338720:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+19:5837:x1876180414256256:12345-0@lo:101: Request processed in 91us (1118us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265173.338725:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789265173.339009:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414256640:0@lo:400: 00000100:00100000:1.0:1789265173.339042:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265173.339090:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876180414256384:0@lo:400: 00000100:00100000:3.0:1789265173.339131:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265173.339160:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789265173.339166:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1876180414256512:0@lo:400: 00000100:00100000:3.0:1789265173.339200:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265173.339397:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789265173.339404:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1876180414256768:0@lo:400: 00000100:00100000:1.0:1789265173.339465:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265173.339563:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414256640 00000100:00100000:0.0:1789265173.339569:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414256640 00000100:00100000:0.0:1789265173.339595:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789265173.339602:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c0d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414256640:12345-0@lo:400: 00000100:00100000:0.0:1789265173.339650:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c0d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414256640:12345-0@lo:400: Request processed in 48us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265173.339663:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789265173.339686:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414256384 00000100:00100000:0.0:1789265173.339689:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414256384 00000100:00100000:0.0:1789265173.339709:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414256512 00000100:00100000:0.0:1789265173.339712:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414256512 00000100:00100000:0.0:1789265173.339730:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414256768 00000100:00100000:0.0:1789265173.339732:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414256768 00000100:00100000:0.0:1789265173.339744:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789265173.339750:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10088e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876180414256384:12345-0@lo:400: 00000100:00100000:0.0:1789265173.339784:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10088e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876180414256384:12345-0@lo:400: Request processed in 34us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265173.339789:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789265173.339801:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789265173.339807:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10088e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876180414256512:12345-0@lo:400: 00000100:00100000:0.0:1789265173.339844:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10088e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876180414256512:12345-0@lo:400: Request processed in 37us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265173.339849:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789265173.339861:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789265173.339866:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c0d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876180414256768:12345-0@lo:400: 00000100:00100000:0.0:1789265173.339890:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c0d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876180414256768:12345-0@lo:400: Request processed in 25us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265173.339895:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1789265173.339914:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789265173.339942:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a0f02da1180 x1876180414256000/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789265183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265173.339953:0:3314:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789265173.339961:0:3314:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1789265173.339975:0:3314:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789265173.339990:0:3314:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789265173.339993:0:3314:0:(import.c:65:import_set_state_nolock()) ffff8a103fac0800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789265173.340006:0:3314:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789265173.340012:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1876180414256000:0@lo:8: 00010000:00080000:0.0:1789265173.340046:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a103c0d5f80 x1876180414256512/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265189 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265173.340056:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1876180414256512:0@lo:400: 00010000:00080000:0.0:1789265173.340064:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a103c0d4000 x1876180414256384/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265189 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265173.340071:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876180414256384:0@lo:400: 00010000:00080000:1.0:1789265173.340295:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a103c0d4e00 x1876180414256768/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265189 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265173.340304:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1876180414256768:0@lo:400: 00010000:00080000:1.0:1789265173.340313:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a103c0d4700 x1876180414256640/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265189 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265173.340319:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414256640:0@lo:400: 00000004:00080000:1.0:1789265173.340340:0:8081:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789265173.340462:0:8081:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 219145385726ns, next at 0ns, rc = 0 00000100:00100000:0.0:1789265173.341439:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414256256:0@lo:101: 00010000:00010000:0.0:1789265173.341460:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff8a103fad7600/0x27274ba5bb951e24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951e32 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265173.341474:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff8a103fad7600/0x27274ba5bb951e24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x27274ba5bb951e32 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265173.341533:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c07b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414256896:0@lo:501: 00000100:00100000:0.0:1789265173.341576:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265173.341605:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103bb4f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265173.341620:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414256896 00000100:00100000:0.0:1789265173.341624:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414256896 00000100:00100000:0.0:1789265173.341658:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789265173.341665:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+19:5837:x1876180414256896:12345-0@lo:501: 00000100:00100000:0.0:1789265173.341868:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+19:5837:x1876180414256896:12345-0@lo:501: Request processed in 202us (290us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789265173.341881:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789265173.341918:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c07b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414256896:0@lo:501: 10000000:01000000:0.0:1789265173.341940:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789265173.341946:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a103fad7600/0x27274ba5bb951e24 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951e32 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265173.341954:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff8a103fad7600/0x27274ba5bb951e24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951e32 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789265173.393448:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:3.0:1789265173.419254:0:8082:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1789265173.419286:0:8082:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10088e4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8082:1876180414257152:0@lo:7: 00000100:00100000:3.0:1789265173.419357:0:8082:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265173.419410:0:8082:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10054be180 going to sleep for 11 seconds 00000100:00100000:3.0:1789265173.419437:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789265173.419448:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10088e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414257024:0@lo:13: 00000100:00100000:3.0:1789265173.419475:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265173.419506:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414257152 00000100:00100000:3.0:1789265173.419512:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414257152 00000100:00100000:3.0:1789265173.419564:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789265173.419573:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10088e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8082:x1876180414257152:12345-0@lo:7: 00000100:00080000:2.0:1789265173.421299:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789265173.421324:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414257024 00000100:00100000:2.0:1789265173.421331:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414257024 00000100:00100000:2.0:1789265173.421381:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789265173.421391:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10088e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3318:x1876180414257024:12345-0@lo:13: 00002000:00000024:2.0:1789265173.421573:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1789265173.421658:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10088e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3318:x1876180414257024:12345-0@lo:13: Request processed in 268us (2181us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265173.421664:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1789265173.421750:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a10088e6680 x1876180414257024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265189 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265173.421770:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10088e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414257024:0@lo:13: 00002000:00080000:3.0:1789265173.426819:0:6682:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1789265173.426887:0:6682:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1789265173.427152:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10088e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8082:x1876180414257152:12345-0@lo:7: Request processed in 7576us (7790us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265173.427163:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789265173.427284:0:8082:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a10088e4380 x1876180414257152/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789265189 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265173.427299:0:8082:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10088e4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8082:1876180414257152:0@lo:7: 00000004:00080000:2.0:1789265173.427311:0:8082:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1789265173.427352:0:8082:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8082:1876180414257280:0@lo:5: 00000100:00100000:2.0:1789265173.427383:0:8082:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265173.427548:0:8082:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103cd50000 going to sleep for 11 seconds 00000100:00100000:3.0:1789265173.427582:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414257280 00000100:00100000:3.0:1789265173.427588:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414257280 00000100:00100000:3.0:1789265173.427702:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789265173.427711:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8082:x1876180414257280:12345-0@lo:5: 00002000:00080000:3.0:1789265173.427734:0:6684:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1789265173.427737:0:6684:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1789265173.428124:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:8082:x1876180414257280:12345-0@lo:5: Request processed in 413us (739us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1789265173.428132:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789265173.428190:0:8082:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a0f02da3b80 x1876180414257280/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789265189 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265173.428202:0:8082:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8082:1876180414257280:0@lo:5: 00000004:00080000:0.0:1789265173.428211:0:8082:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1789265173.428235:0:8082:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c07b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8082:1876180414257408:0@lo:700: 00000100:00100000:0.0:1789265173.428263:0:8082:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265173.428289:0:8082:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1018bca0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265173.428345:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414257408 00000100:00100000:1.0:1789265173.428349:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414257408 00000100:00100000:1.0:1789265173.428390:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789265173.428398:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c07a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8082:x1876180414257408:12345-0@lo:700: 00000100:00100000:1.0:1789265173.428433:0:6691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d4700 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6691:1876180414257536:0@lo:700: 00000100:00100000:1.0:1789265173.428470:0:6691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265173.428493:0:6691:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a0f01c9e480 going to sleep for 11 seconds 00000100:00100000:3.0:1789265173.428658:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414257536 00000100:00100000:3.0:1789265173.428662:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414257536 00000100:00100000:3.0:1789265173.428728:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789265173.428734:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c0d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6691:x1876180414257536:12345-0@lo:700: 40000000:02000000:3.0:1789265173.457336:0:5847:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1789265173.462518:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c0d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6691:x1876180414257536:12345-0@lo:700: Request processed in 33774us (34037us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265173.462559:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789265173.462675:0:6691:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a103c0d4700 x1876180414257536/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789265189 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265173.462690:0:6691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d4700 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6691:1876180414257536:0@lo:700: 40000000:02000000:1.0:1789265173.462702:0:6691:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00100000:2.0:1789265173.524406:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1789265173.524433:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:0.0:1789265173.525336:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c07a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8082:x1876180414257408:12345-0@lo:700: Request processed in 96934us (97066us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265173.525363:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789265173.525625:0:8082:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a103c07b100 x1876180414257408/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789265189 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265173.525638:0:8082:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1789265173.525659:0:8082:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c07b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8082:1876180414257408:0@lo:700: 00000004:02000040:3.0:1789265173.551356:0:8082:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1789265173.556407:0:8082:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c079c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8082:1876180414257664:0@lo:5: 00000100:00100000:0.0:1789265173.556677:0:8082:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265173.556796:0:8082:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a102eb77240 going to sleep for 11 seconds 00000100:00100000:3.0:1789265173.556966:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414257664 00000100:00100000:3.0:1789265173.556975:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414257664 00000100:00100000:3.0:1789265173.557071:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789265173.557111:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c07aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8082:x1876180414257664:12345-0@lo:5: 00002000:00080000:0.0:1789265173.564647:0:6682:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1789265173.564668:0:6682:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1789265173.568203:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c07aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8082:x1876180414257664:12345-0@lo:5: Request processed in 11090us (11521us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1789265173.568222:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1789265173.568334:0:8082:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a103c079c00 x1876180414257664/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789265189 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265173.568352:0:8082:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c079c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8082:1876180414257664:0@lo:5: 00000004:00080000:2.0:1789265173.568366:0:8082:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:0.0:1789265173.810619:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265174.834592:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789265175.795721:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:0.0:1789265175.858447:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265176.173267:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265176.173641:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397457536 00000100:00100000:2.0:1789265176.173652:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397457536 00000100:00100000:2.0:1789265176.173695:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 110 00000100:00100000:2.0:1789265176.173704:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2347:x1876180397457536:12345-192.168.203.37@tcp:250: 00010000:00080000:2.0:1789265176.174193:0:5835:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 1c1230cd-a81b-4bcc-a532-e24f5353fef4@192.168.203.37@tcp t0 exp 0000000000000000 cur 221 last 0 00000020:00000080:2.0:1789265176.174227:0:5835:0:(genops.c:1385:class_connect()) connect: client 1c1230cd-a81b-4bcc-a532-e24f5353fef4, cookie 0x27274ba5bb951e39 00000100:00080000:2.0:1789265176.174373:0:5835:0:(import.c:65:import_set_state_nolock()) ffff8a0f029e0000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789265176.174446:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1230cd-a81b-4bcc-a532-e24f5353fef4+5:2347:x1876180397457536:12345-192.168.203.37@tcp:250: Request processed in 741us (1188us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265176.174465:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 110 00000100:00100000:0.0:1789265176.190835:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265176.190916:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397457664 00000100:00100000:2.0:1789265176.190925:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397457664 00000100:00100000:2.0:1789265176.190985:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 111 00000100:00100000:2.0:1789265176.190996:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+5:5574:x1876180397457664:12345-192.168.203.37@tcp:101: 00010000:00010000:2.0:1789265176.191011:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265176.191027:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a103fad7000/0x27274ba5bb951e40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x73b61075d99efc8c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265176.191053:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a103fad7000/0x27274ba5bb951e40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efc8c expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265176.191064:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a103fad7000/0x27274ba5bb951e40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efc8c expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265176.191106:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fad7000, rc 0) 00000100:00100000:2.0:1789265176.191153:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+6:5574:x1876180397457664:12345-192.168.203.37@tcp:101: Request processed in 159us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265176.191160:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 111 00000100:00100000:1.0:1789265176.198954:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265176.201715:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397457792 00000100:00100000:2.0:1789265176.201732:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397457792 00000100:00100000:2.0:1789265176.201814:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 112 00000100:00100000:2.0:1789265176.201826:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1230cd-a81b-4bcc-a532-e24f5353fef4+6:5574:x1876180397457792:12345-192.168.203.37@tcp:501: 00000100:00100000:2.0:1789265176.202256:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1230cd-a81b-4bcc-a532-e24f5353fef4+6:5574:x1876180397457792:12345-192.168.203.37@tcp:501: Request processed in 431us (3312us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789265176.202264:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 112 00000100:00100000:3.0:1789265176.206894:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265176.208390:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397457920 00000100:00100000:0.0:1789265176.208404:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397457920 00000100:00100000:0.0:1789265176.208471:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 113 00000100:00100000:0.0:1789265176.208481:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1230cd-a81b-4bcc-a532-e24f5353fef4+6:5574:x1876180397457920:12345-192.168.203.37@tcp:101: 00010000:00010000:0.0:1789265176.208498:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265176.208517:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1017262600/0x27274ba5bb951e47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x73b61075d99efc93 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265176.208542:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1017262600/0x27274ba5bb951e47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efc93 expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265176.208553:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1017262600/0x27274ba5bb951e47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efc93 expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265176.208561:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1017262600, rc 0) 00000100:00100000:0.0:1789265176.208629:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1230cd-a81b-4bcc-a532-e24f5353fef4+7:5574:x1876180397457920:12345-192.168.203.37@tcp:101: Request processed in 149us (1743us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265176.208636:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 113 00000100:00100000:3.0:1789265176.213478:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265176.214067:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397458048 00000100:00100000:2.0:1789265176.214134:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397458048 00000100:00100000:2.0:1789265176.214254:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 114 00000100:00100000:2.0:1789265176.214272:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+7:5574:x1876180397458048:12345-192.168.203.37@tcp:501: 00000100:00100000:2.0:1789265176.215761:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+8:5574:x1876180397458048:12345-192.168.203.37@tcp:501: Request processed in 1490us (2284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265176.215775:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 114 00000100:00100000:2.0:1789265176.222212:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265176.222696:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397458176 00000100:00100000:3.0:1789265176.222706:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397458176 00000100:00100000:3.0:1789265176.222766:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 115 00000100:00100000:3.0:1789265176.222776:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1230cd-a81b-4bcc-a532-e24f5353fef4+8:5574:x1876180397458176:12345-192.168.203.37@tcp:503: 00000100:00100000:2.0:1789265176.224342:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1230cd-a81b-4bcc-a532-e24f5353fef4+8:5574:x1876180397458176:12345-192.168.203.37@tcp:503: Request processed in 1560us (2131us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265176.226693:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 115 00000100:00100000:1.0:1789265176.233702:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265176.235815:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397458304 00000100:00100000:2.0:1789265176.235830:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397458304 00000100:00100000:2.0:1789265176.235887:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 116 00000100:00100000:2.0:1789265176.235898:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+8:5593:x1876180397458304:12345-192.168.203.37@tcp:502: 00000100:00100000:2.0:1789265176.236449:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+8:5593:x1876180397458304:12345-192.168.203.37@tcp:502: Request processed in 552us (2756us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265176.236456:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 116 00000100:00100000:1.0:1789265176.271134:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265176.271205:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397458432 00000100:00100000:0.0:1789265176.271216:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397458432 00000100:00100000:0.0:1789265176.271270:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 117 00000100:00100000:0.0:1789265176.271280:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1230cd-a81b-4bcc-a532-e24f5353fef4+8:5593:x1876180397458432:12345-192.168.203.37@tcp:502: 00000100:00100000:0.0:1789265176.271623:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1230cd-a81b-4bcc-a532-e24f5353fef4+8:5593:x1876180397458432:12345-192.168.203.37@tcp:502: Request processed in 342us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265176.271638:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 117 00000100:00100000:1.0:1789265176.279325:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265176.279497:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397458560 00000100:00100000:0.0:1789265176.279507:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397458560 00000100:00100000:0.0:1789265176.279560:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 118 00000100:00100000:0.0:1789265176.279570:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1230cd-a81b-4bcc-a532-e24f5353fef4+8:5574:x1876180397458560:12345-192.168.203.37@tcp:101: 00010000:00010000:0.0:1789265176.279586:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265176.279603:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1017263800/0x27274ba5bb951e4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x73b61075d99efcbd expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265176.279631:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1017263800/0x27274ba5bb951e4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efcbd expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265176.279642:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1017263800/0x27274ba5bb951e4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efcbd expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265176.279652:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1017263800, rc 0) 00000100:00100000:0.0:1789265176.279703:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1230cd-a81b-4bcc-a532-e24f5353fef4+9:5574:x1876180397458560:12345-192.168.203.37@tcp:101: Request processed in 134us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265176.279709:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 118 00000100:00100000:1.0:1789265176.286756:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265176.286834:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397458688 00000100:00100000:0.0:1789265176.286845:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397458688 00000100:00100000:0.0:1789265176.286893:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 119 00000100:00100000:0.0:1789265176.286903:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1230cd-a81b-4bcc-a532-e24f5353fef4+9:5574:x1876180397458688:12345-192.168.203.37@tcp:256: 20000000:01000000:0.0:1789265176.286925:0:5833:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789265176.286947:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789265176.286952:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789265176.286955:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789265176.287228:0:5833:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1789265176.289805:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1230cd-a81b-4bcc-a532-e24f5353fef4+9:5574:x1876180397458688:12345-192.168.203.37@tcp:256: Request processed in 2894us (3050us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265176.289820:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 119 00000100:00100000:2.0:1789265176.299923:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265176.300104:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397458816 00000100:00100000:1.0:1789265176.300115:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397458816 00000100:00100000:1.0:1789265176.300164:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 120 00000100:00100000:1.0:1789265176.300173:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10119dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+9:5574:x1876180397458816:12345-192.168.203.37@tcp:101: 00010000:00010000:1.0:1789265176.300189:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265176.300205:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a101b596000/0x27274ba5bb951e55 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x73b61075d99efcc4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265176.300232:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a101b596000/0x27274ba5bb951e55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efcc4 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265176.300244:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a101b596000/0x27274ba5bb951e55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efcc4 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265176.300268:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a101b596000, rc 0) 00000100:00100000:1.0:1789265176.300319:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10119dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+10:5574:x1876180397458816:12345-192.168.203.37@tcp:101: Request processed in 147us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265176.300325:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 120 00000100:00100000:0.0:1789265176.310507:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265176.310614:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397458944 00000100:00100000:2.0:1789265176.310624:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397458944 00000100:00100000:2.0:1789265176.310682:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 121 00000100:00100000:2.0:1789265176.310693:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10119ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1230cd-a81b-4bcc-a532-e24f5353fef4+10:5574:x1876180397458944:12345-192.168.203.37@tcp:501: 00000100:00100000:2.0:1789265176.310973:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10119ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1230cd-a81b-4bcc-a532-e24f5353fef4+10:5574:x1876180397458944:12345-192.168.203.37@tcp:501: Request processed in 281us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265176.310989:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 121 00000100:00100000:1.0:1789265176.319633:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265176.319708:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397459072 00000100:00100000:3.0:1789265176.319721:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397459072 00000100:00100000:3.0:1789265176.319774:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 122 00000100:00100000:3.0:1789265176.319785:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10119dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1230cd-a81b-4bcc-a532-e24f5353fef4+10:5574:x1876180397459072:12345-192.168.203.37@tcp:503: 00000100:00100000:3.0:1789265176.320175:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10119dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1230cd-a81b-4bcc-a532-e24f5353fef4+10:5574:x1876180397459072:12345-192.168.203.37@tcp:503: Request processed in 390us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265176.320182:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 122 00000100:00100000:0.0:1789265176.330118:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265176.330188:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397459200 00000100:00100000:1.0:1789265176.330197:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397459200 00000100:00100000:1.0:1789265176.330319:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 123 00000100:00100000:1.0:1789265176.330330:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10119dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+10:5597:x1876180397459200:12345-192.168.203.37@tcp:502: 00000100:00100000:1.0:1789265176.330630:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10119dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+10:5597:x1876180397459200:12345-192.168.203.37@tcp:502: Request processed in 301us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265176.330638:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 123 00000100:00100000:2.0:1789265176.345499:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265176.345531:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397459328 00000100:00100000:2.0:1789265176.345541:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397459328 00000100:00100000:2.0:1789265176.345586:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 124 00000100:00100000:2.0:1789265176.345596:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10119df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1230cd-a81b-4bcc-a532-e24f5353fef4+10:5597:x1876180397459328:12345-192.168.203.37@tcp:502: 00000100:00100000:2.0:1789265176.345804:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10119df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1230cd-a81b-4bcc-a532-e24f5353fef4+10:5597:x1876180397459328:12345-192.168.203.37@tcp:502: Request processed in 208us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265176.345812:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 124 00000100:00100000:3.0:1789265176.354287:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265176.354826:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397459456 00000100:00100000:2.0:1789265176.354837:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397459456 00000100:00100000:2.0:1789265176.354882:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 4 00000100:00100000:2.0:1789265176.354890:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10088e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2347:x1876180397459456:12345-192.168.203.37@tcp:38: 00010000:00080000:2.0:1789265176.354918:0:5842:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 4b820fcb-1bab-4b78-bfa4-355c22a09cf8@192.168.203.37@tcp t0 exp 0000000000000000 cur 222 last 0 00000020:00000080:2.0:1789265176.354977:0:5842:0:(genops.c:1385:class_connect()) connect: client 4b820fcb-1bab-4b78-bfa4-355c22a09cf8, cookie 0x27274ba5bb951e5c 00000004:00100000:2.0:1789265176.355006:0:5842:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1789265176.355012:0:5842:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1789265176.390759:0:5842:0:(import.c:65:import_set_state_nolock()) ffff8a103d89d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789265176.390881:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10088e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:2347:x1876180397459456:12345-192.168.203.37@tcp:38: Request processed in 35989us (36602us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265176.390892:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 4 00010000:00010000:1.0:1789265176.883849:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265177.394469:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789265177.394494:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c078000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414257792:0@lo:13: 00000100:00100000:2.0:1789265177.394563:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265177.394784:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414257792 00000100:00100000:0.0:1789265177.394792:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414257792 00000100:00100000:0.0:1789265177.394856:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789265177.394866:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876180414257792:12345-0@lo:13: 00002000:00000024:0.0:1789265177.394901:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789265177.394966:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876180414257792:12345-0@lo:13: Request processed in 103us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265177.394974:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1789265177.395063:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a103c078000 x1876180414257792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265193 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265177.395115:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c078000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414257792:0@lo:13: 00000100:00080000:2.0:1789265177.395230:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789265177.402855:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265177.402946:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397459584 00000100:00100000:0.0:1789265177.402964:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397459584 00000100:00080000:2.0:1789265177.403171:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265177.403268:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 5 00000100:00100000:0.0:1789265177.403602:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:0:x1876180397459584:12345-192.168.203.37@tcp:41: 00000004:00000024:0.0:1789265177.403647:0:5840:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1789265177.403765:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:0:x1876180397459584:12345-192.168.203.37@tcp:41: Request processed in 486us (919us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265177.403773:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 5 00000100:00100000:1.0:1789265177.410726:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265177.410808:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397459712 00000100:00100000:0.0:1789265177.410817:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397459712 00000100:00100000:0.0:1789265177.410870:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 6 00000100:00100000:0.0:1789265177.410880:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c0d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:5574:x1876180397459712:12345-192.168.203.37@tcp:41: 00000004:00000024:0.0:1789265177.410908:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1789265177.410983:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c0d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:5574:x1876180397459712:12345-192.168.203.37@tcp:41: Request processed in 104us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265177.410990:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 6 00000100:00100000:2.0:1789265177.423843:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265177.427453:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397459840 00000100:00100000:0.0:1789265177.427469:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397459840 00000100:00100000:0.0:1789265177.427605:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 7 00000100:00100000:0.0:1789265177.427616:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:5574:x1876180397459840:12345-192.168.203.37@tcp:40: 00000100:00100000:0.0:1789265177.427711:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:5574:x1876180397459840:12345-192.168.203.37@tcp:40: Request processed in 97us (3877us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265177.427719:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 7 00000100:00100000:1.0:1789265177.433339:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265177.433379:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265177.433688:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397459968 00000100:00100000:3.0:1789265177.433703:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397459968 00000100:00100000:2.0:1789265177.433744:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397460096 00000100:00100000:2.0:1789265177.433764:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397460096 00000100:00100000:3.0:1789265177.434056:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 8 00000100:00100000:3.0:1789265177.434068:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c0d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2347:x1876180397459968:12345-192.168.203.37@tcp:8: 00010000:00080000:0.0:1789265177.434815:0:6684:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 4b820fcb-1bab-4b78-bfa4-355c22a09cf8@192.168.203.37@tcp t0 exp 0000000000000000 cur 223 last 0 00000020:00000080:0.0:1789265177.434869:0:6684:0:(genops.c:1385:class_connect()) connect: client 4b820fcb-1bab-4b78-bfa4-355c22a09cf8, cookie 0x27274ba5bb951e63 00002000:00100000:0.0:1789265177.434887:0:6684:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4b820fcb-1bab-4b78-bfa4-355c22a09cf8/ffff8a103fac7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113969 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789265177.434902:0:6684:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789265177.435419:0:6684:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789265177.435465:0:6684:0:(import.c:65:import_set_state_nolock()) ffff8a103fac7800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789265177.435681:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c0d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:2347:x1876180397459968:12345-192.168.203.37@tcp:8: Request processed in 1612us (2353us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265177.435693:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 8 00000100:00100000:0.0:1789265177.435728:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 9 00000100:00100000:0.0:1789265177.435735:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c0d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2347:x1876180397460096:12345-192.168.203.37@tcp:8: 00010000:00080000:0.0:1789265177.435760:0:6684:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 4b820fcb-1bab-4b78-bfa4-355c22a09cf8@192.168.203.37@tcp t0 exp 0000000000000000 cur 223 last 0 00000020:00000080:0.0:1789265177.435809:0:6684:0:(genops.c:1385:class_connect()) connect: client 4b820fcb-1bab-4b78-bfa4-355c22a09cf8, cookie 0x27274ba5bb951e6a 00002000:00100000:0.0:1789265177.435817:0:6684:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4b820fcb-1bab-4b78-bfa4-355c22a09cf8/ffff8a103fac3800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113969 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789265177.435838:0:6684:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789265177.436133:0:6684:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789265177.436153:0:6684:0:(import.c:65:import_set_state_nolock()) ffff8a103fac5800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789265177.436192:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c0d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:2347:x1876180397460096:12345-192.168.203.37@tcp:8: Request processed in 455us (2812us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265177.436200:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 9 00000100:00100000:1.0:1789265177.442478:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265177.444016:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397460224 00000100:00100000:3.0:1789265177.444039:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397460224 00000100:00100000:3.0:1789265177.444217:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 0 00000100:00100000:3.0:1789265177.444231:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c0d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:5574:x1876180397460224:12345-192.168.203.37@tcp:33: 00000100:00100000:2.0:1789265177.447307:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265177.448767:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397460352 00000100:00100000:3.0:1789265177.448788:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397460352 00000100:00100000:3.0:1789265177.448877:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 125 00000100:00100000:3.0:1789265177.448891:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10119de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1230cd-a81b-4bcc-a532-e24f5353fef4+10:2350:x1876180397460352:12345-192.168.203.37@tcp:400: 00000100:00100000:3.0:1789265177.449016:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10119de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1230cd-a81b-4bcc-a532-e24f5353fef4+10:2350:x1876180397460352:12345-192.168.203.37@tcp:400: Request processed in 128us (1722us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265177.449023:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 125 00000004:00080000:3.0:1789265177.477334:0:5843:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 32999us 00000004:00200000:3.0:1789265177.509615:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1789265177.509783:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c0d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:5574:x1876180397460224:12345-192.168.203.37@tcp:33: Request processed in 65547us (67313us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265177.509797:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 0 00000100:00100000:2.0:1789265177.703874:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265177.704035:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397460480 00000100:00100000:0.0:1789265177.704050:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397460480 00000100:00100000:0.0:1789265177.704149:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 8 00000100:00100000:0.0:1789265177.704163:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:5613:x1876180397460480:12345-192.168.203.37@tcp:101: 00010000:00010000:0.0:1789265177.704192:0:7934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265177.704508:0:7934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262200/0x27274ba5bb951e71 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99efcee expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265177.704612:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262800/0x27274ba5bb951e78 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265177.704735:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262800/0x27274ba5bb951e78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265177.704754:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262800/0x27274ba5bb951e78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265177.704794:0:7934:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789265177.704798:0:7934:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789265177.704814:0:7934:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262800/0x27274ba5bb951e78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265177.704842:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262200/0x27274ba5bb951e71 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efcee expref: 8 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265177.704863:0:7934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262800/0x27274ba5bb951e78 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efcee expref: 7 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265177.704891:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a101b706c00) 00010000:00010000:0.0:1789265177.704895:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789265177.704898:0:7934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1017262800, rc 0) 00000100:00100000:0.0:1789265177.705066:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+7:5613:x1876180397460480:12345-192.168.203.37@tcp:101: Request processed in 904us (1205us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265177.705125:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 8 00010000:00010000:0.0:1789265177.906323:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265178.419114:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c079f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1876180414258176:0@lo:400: 00000100:00100000:3.0:1789265178.419188:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265178.419262:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789265178.419269:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c07b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414258304:0@lo:400: 00000100:00100000:3.0:1789265178.419296:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265178.419388:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414258176 00000100:00100000:0.0:1789265178.419396:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414258176 00000100:00100000:0.0:1789265178.419457:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789265178.419467:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10088e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876180414258176:12345-0@lo:400: 00000100:00100000:0.0:1789265178.419520:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10088e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876180414258176:12345-0@lo:400: Request processed in 54us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265178.419526:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1789265178.419595:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265178.419626:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c079f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1876180414258176:0@lo:400: 00000100:00100000:2.0:1789265178.419866:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c078e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876180414258048:0@lo:400: 00000100:00100000:2.0:1789265178.419899:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265178.419929:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c078000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414258560:0@lo:400: 00000100:00100000:2.0:1789265178.419989:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265178.420025:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789265178.420031:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c078380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:871daf34-1206-40e7-bd71-78303abe4d37:3316:1876180414257920:0@lo:400: 00000100:00100000:2.0:1789265178.420058:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265178.420113:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c079180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1876180414258432:0@lo:400: 00000100:00100000:2.0:1789265178.420133:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265178.420156:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414258304 00000100:00100000:2.0:1789265178.420159:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414258304 00000100:00100000:2.0:1789265178.420186:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414258560 00000100:00100000:2.0:1789265178.420189:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414258560 00000100:00100000:2.0:1789265178.420206:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789265178.420213:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10088e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1876180414258304:12345-0@lo:400: 00000100:00100000:2.0:1789265178.420247:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10088e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1876180414258304:12345-0@lo:400: Request processed in 35us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265178.420252:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789265178.420269:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789265178.420275:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414258560:12345-0@lo:400: 00000100:00100000:2.0:1789265178.420308:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414258560:12345-0@lo:400: Request processed in 33us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265178.420321:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789265178.420341:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414257920 00000100:00100000:2.0:1789265178.420344:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414257920 00000100:00100000:2.0:1789265178.420365:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789265178.420371:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10119dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+19:3316:x1876180414257920:12345-0@lo:400: 00000100:00100000:2.0:1789265178.420401:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10119dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+19:3316:x1876180414257920:12345-0@lo:400: Request processed in 30us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265178.420406:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789265178.420440:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c078380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:871daf34-1206-40e7-bd71-78303abe4d37:3316:1876180414257920:0@lo:400: 00010000:00080000:2.0:1789265178.420452:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a103c078000 x1876180414258560/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265178.420461:0:3316:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1789265178.420472:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c078000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414258560:0@lo:400: 00000100:00080000:3.0:1789265178.420539:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789265178.420550:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414258048 00000100:00100000:3.0:1789265178.420559:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414258048 00000100:00100000:3.0:1789265178.420591:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414258432 00000100:00100000:3.0:1789265178.420594:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414258432 00000100:00100000:3.0:1789265178.420629:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789265178.420636:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876180414258048:12345-0@lo:400: 00000100:00100000:3.0:1789265178.420675:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876180414258048:12345-0@lo:400: Request processed in 40us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265178.420682:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789265178.420695:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789265178.420702:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876180414258432:12345-0@lo:400: 00000100:00100000:3.0:1789265178.420727:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876180414258432:12345-0@lo:400: Request processed in 26us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265178.420733:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1789265178.420751:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789265178.420768:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a103c07b800 x1876180414258304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265178.420778:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c07b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414258304:0@lo:400: 00000100:00100000:3.0:1789265178.420811:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c079180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1876180414258432:0@lo:400: 00000100:00100000:3.0:1789265178.420825:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c078e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876180414258048:0@lo:400: 00010000:00010000:0.0:1789265178.930411:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265178.930463:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789265178.930487:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414258688:0@lo:13: 00000100:00100000:2.0:1789265178.930554:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265178.930665:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414258688 00000100:00100000:0.0:1789265178.930672:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414258688 00000100:00100000:0.0:1789265178.930722:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789265178.930731:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876180414258688:12345-0@lo:13: 00002000:00000024:0.0:1789265178.930752:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789265178.930798:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876180414258688:12345-0@lo:13: Request processed in 68us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265178.930805:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1789265178.930885:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a103c0d4000 x1876180414258688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265194 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265178.930904:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414258688:0@lo:13: 00000100:00100000:1.0:1789265179.577668:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265179.577750:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397460608 00000100:00100000:3.0:1789265179.577760:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397460608 00000100:00100000:3.0:1789265179.577843:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 9 00000100:00100000:3.0:1789265179.577852:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c0d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+7:5666:x1876180397460608:12345-192.168.203.37@tcp:41: 00000004:00000024:3.0:1789265179.577892:0:5842:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1789265179.577973:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c0d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+7:5666:x1876180397460608:12345-192.168.203.37@tcp:41: Request processed in 122us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265179.577998:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 9 00000100:00080000:0.0:1789265179.578165:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265179.584239:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265179.584541:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397460736 00000100:00100000:0.0:1789265179.584550:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397460736 00000100:00100000:0.0:1789265179.584696:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 8 00000100:00100000:0.0:1789265179.584706:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c0d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:5666:x1876180397460736:12345-192.168.203.37@tcp:13: 00002000:00000024:0.0:1789265179.584745:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789265179.584821:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c0d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:5666:x1876180397460736:12345-192.168.203.37@tcp:13: Request processed in 116us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265179.584832:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 8 00000100:00080000:3.0:1789265179.587789:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789265179.589738:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265179.590341:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397460864 00000100:00100000:0.0:1789265179.590350:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397460864 00000100:00080000:3.0:1789265179.590570:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789265179.590709:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 9 00000100:00100000:0.0:1789265179.590720:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:5666:x1876180397460864:12345-192.168.203.37@tcp:13: 00002000:00000024:0.0:1789265179.590762:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789265179.590829:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:5666:x1876180397460864:12345-192.168.203.37@tcp:13: Request processed in 111us (1100us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265179.590836:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 9 00010000:00010000:0.0:1789265179.955266:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789265180.494639:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4b820fcb-1bab-4b78-bfa4-355c22a09cf8 00010000:00010000:0.0:1789265180.978462:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789265181.534391:0:5863:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4b820fcb-1bab-4b78-bfa4-355c22a09cf8 00000001:02000400:2.0:1789265181.868691:0:8286:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1789265182.005312:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789265182.075492:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4b820fcb-1bab-4b78-bfa4-355c22a09cf8 00000100:00100000:1.0:1789265182.448281:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265182.451992:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397460992 00000100:00100000:2.0:1789265182.452006:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397460992 00000100:00100000:2.0:1789265182.452058:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 127 00000100:00100000:2.0:1789265182.452933:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10119dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1230cd-a81b-4bcc-a532-e24f5353fef4+10:2351:x1876180397460992:12345-192.168.203.37@tcp:400: 00000100:00100000:2.0:1789265182.453021:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10119dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1230cd-a81b-4bcc-a532-e24f5353fef4+10:2351:x1876180397460992:12345-192.168.203.37@tcp:400: Request processed in 945us (4746us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265182.453029:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 127 00000100:00100000:3.0:1789265182.453217:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265182.453672:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397461120 00000100:00100000:2.0:1789265182.453678:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397461120 00000100:00100000:2.0:1789265182.453780:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 19 00000100:00100000:2.0:1789265182.453790:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10088e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:2351:x1876180397461120:12345-192.168.203.37@tcp:400: 00000100:00100000:2.0:1789265182.453850:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10088e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:2351:x1876180397461120:12345-192.168.203.37@tcp:400: Request processed in 61us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265182.453859:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 19 00000100:00080000:3.0:1789265182.456545:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265182.456804:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265182.459133:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397461376 00000100:00100000:3.0:1789265182.459146:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397461376 00000100:00100000:3.0:1789265182.459210:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 7 00000100:00100000:3.0:1789265182.459225:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10088e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+5:2350:x1876180397461376:12345-192.168.203.37@tcp:400: 00000100:00100000:3.0:1789265182.459294:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10088e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+5:2350:x1876180397461376:12345-192.168.203.37@tcp:400: Request processed in 71us (2495us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265182.459302:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 7 00000100:00100000:3.0:1789265182.459375:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265182.459492:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397461248 00000100:00100000:3.0:1789265182.459497:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397461248 00000100:00100000:3.0:1789265182.459529:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 8 00000100:00100000:3.0:1789265182.459536:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10088e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+5:2350:x1876180397461248:12345-192.168.203.37@tcp:400: 00000100:00100000:3.0:1789265182.459571:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10088e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+5:2350:x1876180397461248:12345-192.168.203.37@tcp:400: Request processed in 35us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265182.459578:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 8 00000100:00080000:3.0:1789265182.459601:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789265182.460696:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789265182.514595:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789265182.514620:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c07b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414258816:0@lo:13: 00000100:00100000:3.0:1789265182.514690:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265182.514970:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414258816 00000100:00100000:0.0:1789265182.514979:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414258816 00000100:00100000:0.0:1789265182.515043:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789265182.515052:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10088e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876180414258816:12345-0@lo:13: 00002000:00000024:0.0:1789265182.515116:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789265182.515162:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10088e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876180414258816:12345-0@lo:13: Request processed in 111us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265182.515169:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1789265182.515211:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a103c07b100 x1876180414258816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265198 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265182.515238:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c07b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414258816:0@lo:13: 00000100:00080000:3.0:1789265182.515404:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789265183.028468:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265183.545634:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10088e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:871daf34-1206-40e7-bd71-78303abe4d37:3315:1876180414258944:0@lo:400: 00000100:00100000:3.0:1789265183.545694:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265183.545729:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102e765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1876180414259456:0@lo:400: 00000100:00100000:3.0:1789265183.545748:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265183.545768:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789265183.545772:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102e765c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876180414259072:0@lo:400: 00000100:00100000:3.0:1789265183.545805:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265183.545819:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102e764e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414259584:0@lo:400: 00000100:00100000:3.0:1789265183.545836:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265183.545856:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102e764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1876180414259200:0@lo:400: 00000100:00100000:3.0:1789265183.545874:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265183.545888:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789265183.545892:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102e766a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414259328:0@lo:400: 00000100:00100000:3.0:1789265183.545907:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265183.545944:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414258944 00000100:00100000:3.0:1789265183.545951:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414258944 00000100:00100000:3.0:1789265183.545987:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789265183.545996:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a100881c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+19:3315:x1876180414258944:12345-0@lo:400: 00000100:00100000:3.0:1789265183.546040:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a100881c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+19:3315:x1876180414258944:12345-0@lo:400: Request processed in 45us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265183.546046:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789265183.546097:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414259456 00000100:00100000:3.0:1789265183.546101:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414259456 00000100:00100000:3.0:1789265183.546130:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414259072 00000100:00100000:3.0:1789265183.546133:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414259072 00000100:00100000:3.0:1789265183.546145:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414259200 00000100:00100000:3.0:1789265183.546155:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414259200 00000100:00100000:3.0:1789265183.546171:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789265183.546176:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102e766680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876180414259456:12345-0@lo:400: 00000100:00100000:3.0:1789265183.546204:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102e766680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876180414259456:12345-0@lo:400: Request processed in 29us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265183.546210:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789265183.546222:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789265183.546227:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102e764700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876180414259072:12345-0@lo:400: 00000100:00100000:3.0:1789265183.546247:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102e764700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876180414259072:12345-0@lo:400: Request processed in 21us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265183.546252:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789265183.546261:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789265183.546265:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102e765f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876180414259200:12345-0@lo:400: 00000100:00100000:3.0:1789265183.546287:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102e765f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876180414259200:12345-0@lo:400: Request processed in 22us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265183.546292:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789265183.546309:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414259584 00000100:00100000:3.0:1789265183.546311:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414259584 00000100:00100000:3.0:1789265183.546329:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414259328 00000100:00100000:3.0:1789265183.546332:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414259328 00000100:00100000:3.0:1789265183.546341:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789265183.546346:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102e764000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414259584:12345-0@lo:400: 00000100:00100000:3.0:1789265183.546372:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102e764000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414259584:12345-0@lo:400: Request processed in 25us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265183.546377:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789265183.546387:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789265183.546392:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102e764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1876180414259328:12345-0@lo:400: 00000100:00100000:3.0:1789265183.546425:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102e764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1876180414259328:12345-0@lo:400: Request processed in 32us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265183.546430:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789265183.546466:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102e765c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876180414259072:0@lo:400: 00010000:00080000:3.0:1789265183.546477:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a102e764e00 x1876180414259584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265183.546487:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102e764e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414259584:0@lo:400: 00000100:00100000:3.0:1789265183.546494:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10088e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:871daf34-1206-40e7-bd71-78303abe4d37:3315:1876180414258944:0@lo:400: 00000100:00100000:3.0:1789265183.546502:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102e765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1876180414259456:0@lo:400: 00000100:00080000:3.0:1789265183.546523:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789265183.546527:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789265183.546542:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a102e766a00 x1876180414259328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265183.546550:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102e766a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414259328:0@lo:400: 00000100:00100000:3.0:1789265183.546558:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102e764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1876180414259200:0@lo:400: 00010000:00010000:0.0:1789265184.050321:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265184.050618:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789265184.050642:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1016d45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414259712:0@lo:13: 00000100:00100000:0.0:1789265184.050709:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265184.050896:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414259712 00000100:00100000:2.0:1789265184.050912:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414259712 00000100:00100000:2.0:1789265184.050973:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789265184.050982:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c07b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876180414259712:12345-0@lo:13: 00002000:00000024:2.0:1789265184.051014:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789265184.051059:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c07b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876180414259712:12345-0@lo:13: Request processed in 79us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265184.051065:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1789265184.051230:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1016d45c00 x1876180414259712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265200 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265184.051249:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1016d45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414259712:0@lo:13: 00000020:00000080:2.0:1789265184.796615:0:8435:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffce42c9bf0 20000000:00000080:2.0:1789265184.796633:0:8435:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8a102ee9a000 uarg=0000000000000000 20000000:01000000:2.0:1789265184.796668:0:8435:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1789265184.796670:0:8435:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1789265184.796673:0:8435:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1789265184.796678:0:8435:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1789265184.796684:0:8435:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1789265184.796698:0:8435:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789265184.796713:0:8435:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1789265184.796890:0:8435:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1789265184.796893:0:8435:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789265184.801111:0:8436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1789265184.801714:0:8435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1789265184.801780:0:8435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1789265184.801818:0:8435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:3.0:1789265184.801831:0:8435:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789265184.801834:0:8435:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789265184.802635:0:8437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:2.0:1789265184.803033:0:8435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:2.0:1789265184.803110:0:8435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:2.0:1789265184.803147:0:8435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:2.0:1789265184.803158:0:8435:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789265184.803161:0:8435:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789265184.804612:0:8438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1789265184.805784:0:8435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1789265184.805835:0:8435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1789265184.805882:0:8435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:3.0:1789265184.805896:0:8435:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1789265184.805915:0:8435:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789265184.807374:0:8439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1789265184.807804:0:8435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1789265184.807868:0:8435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1789265184.807915:0:8435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:3.0:1789265184.807931:0:8435:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789265184.807949:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a1000030000/0x27274ba5bb951e7f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265184.808396:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1042044000/0x27274ba5bb951d7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb951d75 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265184.808406:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a10421eb600/0x27274ba5bb951da6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb951d9f expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265184.808414:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1017263a00/0x27274ba5bb951dd0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb951dc9 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265184.808421:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a10421ea400/0x27274ba5bb951dde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb951dd7 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265184.808429:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1042044200/0x27274ba5bb951dec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb951de5 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265184.808436:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1042045000/0x27274ba5bb951e08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb951e01 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265184.808443:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a10421eac00/0x27274ba5bb951e32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb951e24 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265184.808453:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a103fad7000/0x27274ba5bb951e40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efc8c expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265184.808475:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1017262600/0x27274ba5bb951e47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efc93 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265184.808483:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a1000030000/0x27274ba5bb951e7f lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265184.808519:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1017262600/0x27274ba5bb951e47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efc93 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265184.808535:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a1017262600/0x27274ba5bb951e47 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efc93 expref: 9 pid: 5835 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265184.808550:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102e764380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1876180414259840:192.168.203.37@tcp:104: 00010000:00010000:3.0:1789265184.808696:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a103fad7000/0x27274ba5bb951e40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efc8c expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265184.808706:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a103fad7000/0x27274ba5bb951e40 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efc8c expref: 9 pid: 5834 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265184.808715:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102e766a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1876180414259968:192.168.203.37@tcp:104: 00010000:00010000:3.0:1789265184.808755:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a10421eac00/0x27274ba5bb951e32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27274ba5bb951e24 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265184.808764:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a10421eac00/0x27274ba5bb951e32 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27274ba5bb951e24 expref: 18 pid: 5833 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265184.808773:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102e765500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1876180414260096:0@lo:104: 00000100:00100000:3.0:1789265184.808818:0:8435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789265184.808861:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1042045000/0x27274ba5bb951e08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27274ba5bb951e01 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265184.808870:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a1042045000/0x27274ba5bb951e08 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27274ba5bb951e01 expref: 18 pid: 5834 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265184.808879:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102e765c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1876180414260224:0@lo:104: 00000100:00100000:3.0:1789265184.808910:0:8435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789265184.808934:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1042044200/0x27274ba5bb951dec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27274ba5bb951de5 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265184.808942:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a1042044200/0x27274ba5bb951dec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27274ba5bb951de5 expref: 18 pid: 5834 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265184.808950:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102e767800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1876180414260352:0@lo:104: 00010000:00010000:3.0:1789265184.809039:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a10421ea400/0x27274ba5bb951dde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27274ba5bb951dd7 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265184.809047:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a10421ea400/0x27274ba5bb951dde lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27274ba5bb951dd7 expref: 18 pid: 5835 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265184.809055:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102e765180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1876180414260480:0@lo:104: 00010000:00010000:3.0:1789265184.809100:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1017263a00/0x27274ba5bb951dd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27274ba5bb951dc9 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265184.809108:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a1017263a00/0x27274ba5bb951dd0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27274ba5bb951dc9 expref: 18 pid: 5834 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265184.809117:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102e765880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1876180414260608:0@lo:104: 00010000:00010000:3.0:1789265184.809148:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a10421eb600/0x27274ba5bb951da6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27274ba5bb951d9f expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265184.809162:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a10421eb600/0x27274ba5bb951da6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27274ba5bb951d9f expref: 18 pid: 5834 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265184.809170:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102e767b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1876180414260736:0@lo:104: 00010000:00010000:3.0:1789265184.809194:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1042044000/0x27274ba5bb951d7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27274ba5bb951d75 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265184.809202:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a1042044000/0x27274ba5bb951d7c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27274ba5bb951d75 expref: 18 pid: 5833 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265184.809211:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102e767100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1876180414260864:0@lo:104: 00000100:00100000:2.0:1789265184.809336:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789265184.809355:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265184.809369:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265184.809378:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265184.809386:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265184.809394:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414260096 00000100:00100000:2.0:1789265184.809400:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414260096 00000100:00100000:2.0:1789265184.809435:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414260224 00000100:00100000:2.0:1789265184.809438:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414260224 00000100:00100000:2.0:1789265184.809447:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414260352 00000100:00100000:2.0:1789265184.809449:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414260352 00000100:00100000:2.0:1789265184.809457:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414260480 00000100:00100000:2.0:1789265184.809459:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414260480 00000100:00100000:2.0:1789265184.809466:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414260608 00000100:00100000:2.0:1789265184.809468:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414260608 00000100:00100000:2.0:1789265184.809477:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414260736 00000100:00100000:2.0:1789265184.809479:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414260736 00000100:00100000:2.0:1789265184.809490:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789265184.809497:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102e764e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:871daf34-1206-40e7-bd71-78303abe4d37+8:8435:x1876180414260096:12345-0@lo:104: 00010000:00010000:2.0:1789265184.809510:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff8a103fad7600/0x27274ba5bb951e24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x27274ba5bb951e32 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265184.809559:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789265184.809571:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102e764e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:871daf34-1206-40e7-bd71-78303abe4d37+8:8435:x1876180414260096:12345-0@lo:104: Request processed in 74us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265184.809578:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789265184.809596:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789265184.809602:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103fc5f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:871daf34-1206-40e7-bd71-78303abe4d37+7:8435:x1876180414260224:12345-0@lo:104: 00010000:00010000:2.0:1789265184.809610:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff8a1017262a00/0x27274ba5bb951e01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x27274ba5bb951e08 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265184.809642:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789265184.809647:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103fc5f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:871daf34-1206-40e7-bd71-78303abe4d37+7:8435:x1876180414260224:12345-0@lo:104: Request processed in 46us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265184.809653:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789265184.809683:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789265184.809690:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:871daf34-1206-40e7-bd71-78303abe4d37+6:8435:x1876180414260352:12345-0@lo:104: 00010000:00010000:2.0:1789265184.809697:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff8a1017263c00/0x27274ba5bb951de5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x27274ba5bb951dec expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265184.809721:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789265184.809726:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:871daf34-1206-40e7-bd71-78303abe4d37+6:8435:x1876180414260352:12345-0@lo:104: Request processed in 37us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265184.809732:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789265184.809742:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789265184.809747:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:871daf34-1206-40e7-bd71-78303abe4d37+5:8435:x1876180414260480:12345-0@lo:104: 00010000:00010000:2.0:1789265184.809753:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff8a1042045200/0x27274ba5bb951dd7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x27274ba5bb951dde expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265184.809784:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1789265184.809792:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:871daf34-1206-40e7-bd71-78303abe4d37+5:8435:x1876180414260480:12345-0@lo:104: Request processed in 46us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265184.809798:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789265184.809809:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789265184.809814:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:871daf34-1206-40e7-bd71-78303abe4d37+4:8435:x1876180414260608:12345-0@lo:104: 00010000:00010000:2.0:1789265184.809822:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff8a1042045c00/0x27274ba5bb951dc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x27274ba5bb951dd0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265184.809847:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1789265184.809851:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:871daf34-1206-40e7-bd71-78303abe4d37+4:8435:x1876180414260608:12345-0@lo:104: Request processed in 37us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265184.809857:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789265184.809867:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789265184.809872:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:871daf34-1206-40e7-bd71-78303abe4d37+3:8435:x1876180414260736:12345-0@lo:104: 00010000:00010000:2.0:1789265184.809879:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff8a10421eaa00/0x27274ba5bb951d9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x27274ba5bb951da6 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265184.809916:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1789265184.809920:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:871daf34-1206-40e7-bd71-78303abe4d37+3:8435:x1876180414260736:12345-0@lo:104: Request processed in 49us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265184.809926:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:2.0:1789265184.810155:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1789265184.810161:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff8a103fad7600/0x27274ba5bb951e24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x27274ba5bb951e32 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265184.810170:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad7600 already unused, calling callback (ffffffffc1ba2c20) 10000000:00010000:2.0:1789265184.810174:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff8a103fad7600/0x27274ba5bb951e24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x27274ba5bb951e32 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265184.810193:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff8a103fad7600/0x27274ba5bb951e24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x27274ba5bb951e32 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265184.810202:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff8a103fad7600/0x27274ba5bb951e24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x27274ba5bb951e32 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265184.810208:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789265184.810336:0:8435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265184.810366:0:8435:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10054be180 going to sleep for 11 seconds 00000100:00100000:3.0:1789265184.810384:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102e765500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1876180414260096:0@lo:104: 00000100:00100000:3.0:1789265184.810393:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102e765c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1876180414260224:0@lo:104: 00000100:00100000:3.0:1789265184.810400:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102e767800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1876180414260352:0@lo:104: 00000100:00100000:3.0:1789265184.810407:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102e765180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1876180414260480:0@lo:104: 00000100:00100000:3.0:1789265184.810413:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102e765880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1876180414260608:0@lo:104: 00000100:00100000:3.0:1789265184.810420:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102e767b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1876180414260736:0@lo:104: 00000100:00100000:0.0:1789265184.810492:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414260864 00000100:00100000:0.0:1789265184.810498:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414260864 00000100:00100000:0.0:1789265184.810522:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789265184.810528:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102e766300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:871daf34-1206-40e7-bd71-78303abe4d37+3:8435:x1876180414260864:12345-0@lo:104: 00010000:00010000:0.0:1789265184.810538:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff8a1042045a00/0x27274ba5bb951d75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x27274ba5bb951d7c expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265184.810579:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1789265184.810584:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102e766300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:871daf34-1206-40e7-bd71-78303abe4d37+3:8435:x1876180414260864:12345-0@lo:104: Request processed in 57us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265184.810589:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789265184.811396:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102e767100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1876180414260864:0@lo:104: 00010000:00010000:2.0:1789265184.811493:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff8a103fad7600/0x27274ba5bb951e24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951e32 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265184.811502:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265184.811523:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff8a103fad7600/0x27274ba5bb951e24 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951e32 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265184.811531:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff8a103fad7600/0x27274ba5bb951e24 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951e32 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265184.811545:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1789265184.811549:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff8a1017262a00/0x27274ba5bb951e01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x27274ba5bb951e08 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265184.811554:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1017262a00 already unused, calling callback (ffffffffc1ba2c20) 10000000:00010000:2.0:1789265184.811558:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff8a1017262a00/0x27274ba5bb951e01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x27274ba5bb951e08 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265184.811566:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff8a1017262a00/0x27274ba5bb951e01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x27274ba5bb951e08 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265184.811572:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff8a1017262a00/0x27274ba5bb951e01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x27274ba5bb951e08 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265184.811589:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789265184.811603:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff8a1017262a00/0x27274ba5bb951e01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951e08 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265184.811609:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265184.811624:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff8a1017262a00/0x27274ba5bb951e01 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951e08 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265184.811632:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff8a1017262a00/0x27274ba5bb951e01 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951e08 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265184.811641:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1789265184.811644:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff8a1017263c00/0x27274ba5bb951de5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x27274ba5bb951dec expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265184.811650:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1017263c00 already unused, calling callback (ffffffffc1ba2c20) 10000000:00010000:2.0:1789265184.811653:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff8a1017263c00/0x27274ba5bb951de5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x27274ba5bb951dec expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265184.811659:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff8a1017263c00/0x27274ba5bb951de5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x27274ba5bb951dec expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265184.811665:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff8a1017263c00/0x27274ba5bb951de5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x27274ba5bb951dec expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265184.811671:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789265184.811682:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff8a1017263c00/0x27274ba5bb951de5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951dec expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265184.811688:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265184.811698:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff8a1017263c00/0x27274ba5bb951de5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951dec expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265184.811705:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff8a1017263c00/0x27274ba5bb951de5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951dec expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265184.811715:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789265184.811718:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff8a1042045200/0x27274ba5bb951dd7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x27274ba5bb951dde expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265184.811724:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1042045200 already unused, calling callback (ffffffffc1ba2c20) 10000000:00010000:2.0:1789265184.811727:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff8a1042045200/0x27274ba5bb951dd7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x27274ba5bb951dde expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265184.811733:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff8a1042045200/0x27274ba5bb951dd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x27274ba5bb951dde expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265184.811738:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff8a1042045200/0x27274ba5bb951dd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x27274ba5bb951dde expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265184.811743:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789265184.811755:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff8a1042045200/0x27274ba5bb951dd7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951dde expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265184.811761:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265184.811766:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff8a1042045200/0x27274ba5bb951dd7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951dde expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265184.811772:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff8a1042045200/0x27274ba5bb951dd7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951dde expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265184.811781:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789265184.811790:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff8a1042045c00/0x27274ba5bb951dc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x27274ba5bb951dd0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265184.811796:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1042045c00 already unused, calling callback (ffffffffc1ba2c20) 10000000:00010000:2.0:1789265184.811799:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff8a1042045c00/0x27274ba5bb951dc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x27274ba5bb951dd0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265184.811806:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff8a1042045c00/0x27274ba5bb951dc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x27274ba5bb951dd0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265184.811812:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff8a1042045c00/0x27274ba5bb951dc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x27274ba5bb951dd0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265184.811816:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789265184.811829:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff8a1042045c00/0x27274ba5bb951dc9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951dd0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265184.811834:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265184.811837:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff8a1042045c00/0x27274ba5bb951dc9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951dd0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265184.811842:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff8a1042045c00/0x27274ba5bb951dc9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951dd0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265184.811850:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789265184.811853:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff8a10421eaa00/0x27274ba5bb951d9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x27274ba5bb951da6 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265184.811859:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a10421eaa00 already unused, calling callback (ffffffffc1ba2c20) 10000000:00010000:2.0:1789265184.811862:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff8a10421eaa00/0x27274ba5bb951d9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x27274ba5bb951da6 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265184.811878:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff8a10421eaa00/0x27274ba5bb951d9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x27274ba5bb951da6 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265184.811885:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff8a10421eaa00/0x27274ba5bb951d9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x27274ba5bb951da6 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265184.811890:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789265184.811917:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff8a10421eaa00/0x27274ba5bb951d9f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951da6 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265184.811923:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265184.811927:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff8a10421eaa00/0x27274ba5bb951d9f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951da6 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265184.811934:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff8a10421eaa00/0x27274ba5bb951d9f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951da6 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265184.811944:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265184.811948:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff8a1042045a00/0x27274ba5bb951d75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27274ba5bb951d7c expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265184.811954:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1042045a00 already unused, calling callback (ffffffffc1ba2c20) 10000000:00010000:2.0:1789265184.811957:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff8a1042045a00/0x27274ba5bb951d75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x27274ba5bb951d7c expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265184.811963:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff8a1042045a00/0x27274ba5bb951d75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x27274ba5bb951d7c expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265184.811979:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff8a1042045a00/0x27274ba5bb951d75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x27274ba5bb951d7c expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265184.811991:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789265184.812017:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff8a1042045a00/0x27274ba5bb951d75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951d7c expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265184.812022:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265184.812027:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff8a1042045a00/0x27274ba5bb951d75 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951d7c expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265184.812034:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff8a1042045a00/0x27274ba5bb951d75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951d7c expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265184.812047:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265184.812049:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265184.812050:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265184.812059:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265184.812563:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:871daf34-1206-40e7-bd71-78303abe4d37:3318:1876180414260992:0@lo:103: 00000100:00100000:0.0:1789265184.812624:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265184.812664:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:871daf34-1206-40e7-bd71-78303abe4d37:3318:1876180414261504:0@lo:103: 00000100:00100000:0.0:1789265184.812684:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265184.812705:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789265184.812711:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:871daf34-1206-40e7-bd71-78303abe4d37:3318:1876180414261376:0@lo:103: 00000100:00100000:0.0:1789265184.812730:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265184.812763:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414260992 00000100:00100000:0.0:1789265184.812769:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414260992 00010000:00010000:0.0:1789265184.812803:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a10421eac00/0x27274ba5bb951e32 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27274ba5bb951e24 expref: 19 pid: 5833 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265184.812824:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414261504 00000100:00100000:0.0:1789265184.812827:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414261504 00010000:00010000:0.0:1789265184.812839:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1017263a00/0x27274ba5bb951dd0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27274ba5bb951dc9 expref: 20 pid: 5834 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265184.812849:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414261376 00000100:00100000:0.0:1789265184.812851:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414261376 00010000:00010000:0.0:1789265184.812859:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a10421ea400/0x27274ba5bb951dde lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27274ba5bb951dd7 expref: 21 pid: 5835 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265184.812872:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789265184.812880:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c079500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:871daf34-1206-40e7-bd71-78303abe4d37+21:3318:x1876180414260992:12345-0@lo:103: 00010000:00010000:0.0:1789265184.812892:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265184.812897:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a10421eac00/0x27274ba5bb951e32 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27274ba5bb951e24 expref: 21 pid: 5833 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265184.812919:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a10421eac00/0x27274ba5bb951e32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27274ba5bb951e24 expref: 21 pid: 5833 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265184.812934:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a10421eac00/0x27274ba5bb951e32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27274ba5bb951e24 expref: 21 pid: 5833 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265184.812948:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265184.812980:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c079500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:871daf34-1206-40e7-bd71-78303abe4d37+20:3318:x1876180414260992:12345-0@lo:103: Request processed in 101us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265184.812987:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789265184.813005:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789265184.813010:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c078e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:871daf34-1206-40e7-bd71-78303abe4d37+19:3318:x1876180414261504:12345-0@lo:103: 00010000:00010000:0.0:1789265184.813023:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265184.813027:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1017263a00/0x27274ba5bb951dd0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27274ba5bb951dc9 expref: 19 pid: 5834 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265184.813035:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1017263a00/0x27274ba5bb951dd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27274ba5bb951dc9 expref: 19 pid: 5834 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265184.813044:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1017263a00/0x27274ba5bb951dd0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27274ba5bb951dc9 expref: 19 pid: 5834 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265184.813054:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265184.813097:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c078e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:871daf34-1206-40e7-bd71-78303abe4d37+18:3318:x1876180414261504:12345-0@lo:103: Request processed in 86us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265184.813103:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789265184.813115:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789265184.813121:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c079180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:871daf34-1206-40e7-bd71-78303abe4d37+17:3318:x1876180414261376:12345-0@lo:103: 00010000:00010000:0.0:1789265184.813129:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265184.813133:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a10421ea400/0x27274ba5bb951dde lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27274ba5bb951dd7 expref: 17 pid: 5835 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265184.813141:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a10421ea400/0x27274ba5bb951dde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27274ba5bb951dd7 expref: 17 pid: 5835 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265184.813151:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a10421ea400/0x27274ba5bb951dde lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27274ba5bb951dd7 expref: 17 pid: 5835 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265184.813159:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265184.813180:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c079180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:871daf34-1206-40e7-bd71-78303abe4d37+16:3318:x1876180414261376:12345-0@lo:103: Request processed in 59us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265184.813194:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789265184.813720:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:871daf34-1206-40e7-bd71-78303abe4d37:3315:1876180414261120:0@lo:103: 00000100:00100000:2.0:1789265184.813753:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265184.813791:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:871daf34-1206-40e7-bd71-78303abe4d37:3315:1876180414261632:0@lo:103: 00000100:00100000:2.0:1789265184.813810:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265184.813822:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789265184.813827:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:871daf34-1206-40e7-bd71-78303abe4d37:3315:1876180414261248:0@lo:103: 00000100:00100000:2.0:1789265184.813845:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265184.813854:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10349c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:871daf34-1206-40e7-bd71-78303abe4d37:3315:1876180414261760:0@lo:103: 00000100:00100000:2.0:1789265184.813872:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265184.813893:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414261120 00000100:00100000:2.0:1789265184.813909:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414261120 00010000:00010000:2.0:1789265184.813932:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1042045000/0x27274ba5bb951e08 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27274ba5bb951e01 expref: 16 pid: 5834 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265184.814158:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:871daf34-1206-40e7-bd71-78303abe4d37:3318:1876180414261376:0@lo:103: 00000100:00100000:0.0:1789265184.814171:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:871daf34-1206-40e7-bd71-78303abe4d37:3318:1876180414260992:0@lo:103: 00000100:00100000:0.0:1789265184.814178:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:871daf34-1206-40e7-bd71-78303abe4d37:3318:1876180414261504:0@lo:103: 00000100:00100000:2.0:1789265184.814251:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414261632 00000100:00100000:2.0:1789265184.814255:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414261632 00010000:00010000:2.0:1789265184.814269:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a10421eb600/0x27274ba5bb951da6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27274ba5bb951d9f expref: 17 pid: 5834 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265184.814369:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414261248 00000100:00100000:3.0:1789265184.814373:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414261248 00010000:00010000:3.0:1789265184.814389:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1042044200/0x27274ba5bb951dec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27274ba5bb951de5 expref: 18 pid: 5834 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265184.814402:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414261760 00000100:00100000:3.0:1789265184.814410:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414261760 00010000:00010000:3.0:1789265184.814421:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1042044000/0x27274ba5bb951d7c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27274ba5bb951d75 expref: 19 pid: 5833 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265184.814433:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789265184.814440:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10349c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:871daf34-1206-40e7-bd71-78303abe4d37+19:3315:x1876180414261120:12345-0@lo:103: 00010000:00010000:3.0:1789265184.814450:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265184.814455:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1042045000/0x27274ba5bb951e08 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27274ba5bb951e01 expref: 19 pid: 5834 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265184.814464:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1042045000/0x27274ba5bb951e08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27274ba5bb951e01 expref: 19 pid: 5834 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265184.814480:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1042045000/0x27274ba5bb951e08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27274ba5bb951e01 expref: 19 pid: 5834 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265184.814493:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265184.814542:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10349c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:871daf34-1206-40e7-bd71-78303abe4d37+18:3315:x1876180414261120:12345-0@lo:103: Request processed in 103us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265184.814549:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789265184.814563:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789265184.814569:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10349c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:871daf34-1206-40e7-bd71-78303abe4d37+17:3315:x1876180414261632:12345-0@lo:103: 00010000:00010000:3.0:1789265184.814578:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265184.814582:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a10421eb600/0x27274ba5bb951da6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27274ba5bb951d9f expref: 17 pid: 5834 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265184.814591:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a10421eb600/0x27274ba5bb951da6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27274ba5bb951d9f expref: 17 pid: 5834 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265184.814601:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a10421eb600/0x27274ba5bb951da6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27274ba5bb951d9f expref: 17 pid: 5834 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265184.814625:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265184.814648:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10349c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:871daf34-1206-40e7-bd71-78303abe4d37+16:3315:x1876180414261632:12345-0@lo:103: Request processed in 79us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265184.814654:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789265184.814665:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789265184.814671:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10349cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:871daf34-1206-40e7-bd71-78303abe4d37+15:3315:x1876180414261248:12345-0@lo:103: 00010000:00010000:3.0:1789265184.814678:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265184.814682:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1042044200/0x27274ba5bb951dec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27274ba5bb951de5 expref: 15 pid: 5834 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265184.814690:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1042044200/0x27274ba5bb951dec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27274ba5bb951de5 expref: 15 pid: 5834 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265184.814700:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1042044200/0x27274ba5bb951dec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27274ba5bb951de5 expref: 15 pid: 5834 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265184.814710:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265184.814730:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10349cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:871daf34-1206-40e7-bd71-78303abe4d37+14:3315:x1876180414261248:12345-0@lo:103: Request processed in 59us (884us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265184.814736:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789265184.814747:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789265184.814754:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10118e5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:871daf34-1206-40e7-bd71-78303abe4d37+13:3315:x1876180414261760:12345-0@lo:103: 00010000:00010000:3.0:1789265184.814761:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265184.814765:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1042044000/0x27274ba5bb951d7c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27274ba5bb951d75 expref: 13 pid: 5833 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265184.814773:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1042044000/0x27274ba5bb951d7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27274ba5bb951d75 expref: 13 pid: 5833 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265184.814789:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1042044000/0x27274ba5bb951d7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27274ba5bb951d75 expref: 13 pid: 5833 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265184.814799:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265184.814820:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10118e5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:871daf34-1206-40e7-bd71-78303abe4d37+12:3315:x1876180414261760:12345-0@lo:103: Request processed in 66us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265184.814826:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789265184.815392:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:871daf34-1206-40e7-bd71-78303abe4d37:3315:1876180414261248:0@lo:103: 00000100:00100000:0.0:1789265184.815402:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10349c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:871daf34-1206-40e7-bd71-78303abe4d37:3315:1876180414261760:0@lo:103: 00000100:00100000:0.0:1789265184.815410:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:871daf34-1206-40e7-bd71-78303abe4d37:3315:1876180414261120:0@lo:103: 00000100:00100000:0.0:1789265184.815417:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:871daf34-1206-40e7-bd71-78303abe4d37:3315:1876180414261632:0@lo:103: 00000100:00100000:3.0:1789265184.820608:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265184.820627:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102e764380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1876180414259840:192.168.203.37@tcp:104: 00000100:00100000:2.0:1789265184.820641:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102e766a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1876180414259968:192.168.203.37@tcp:104: 00010000:00010000:2.0:1789265184.820683:0:8435:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a1000030000/0x27274ba5bb951e7f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265184.823064:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265184.824284:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397461504 00000100:00100000:0.0:1789265184.824296:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397461504 00000100:00100000:1.0:1789265184.824462:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397461632 00000100:00100000:1.0:1789265184.824466:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397461632 00010000:00010000:1.0:1789265184.824499:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a103fad7000/0x27274ba5bb951e40 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efc8c expref: 11 pid: 5834 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265184.824535:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 19 00000100:00100000:1.0:1789265184.824543:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102e767480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+11:2351:x1876180397461632:12345-192.168.203.37@tcp:103: 00010000:00010000:1.0:1789265184.824558:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265184.824563:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a103fad7000/0x27274ba5bb951e40 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efc8c expref: 11 pid: 5834 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265184.824575:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a103fad7000/0x27274ba5bb951e40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efc8c expref: 11 pid: 5834 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265184.824593:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a103fad7000/0x27274ba5bb951e40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efc8c expref: 11 pid: 5834 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265184.824608:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265184.824666:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102e767480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+10:2351:x1876180397461632:12345-192.168.203.37@tcp:103: Request processed in 123us (1617us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265184.824674:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 19 00010000:00010000:2.0:1789265184.825951:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1017262600/0x27274ba5bb951e47 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efc93 expref: 9 pid: 5835 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265184.826005:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 20 00000100:00100000:2.0:1789265184.826133:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102e766d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c1230cd-a81b-4bcc-a532-e24f5353fef4+9:2351:x1876180397461504:12345-192.168.203.37@tcp:103: 00010000:00010000:2.0:1789265184.826147:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265184.826152:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1017262600/0x27274ba5bb951e47 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efc93 expref: 9 pid: 5835 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265184.826167:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1017262600/0x27274ba5bb951e47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efc93 expref: 9 pid: 5835 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265184.826185:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1017262600/0x27274ba5bb951e47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efc93 expref: 9 pid: 5835 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265184.826199:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a1000030000/0x27274ba5bb951e7f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265184.826282:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1000030000/0x27274ba5bb951e7f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265184.826297:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a1000030000/0x27274ba5bb951e7f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265184.826304:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a1000030000/0x27274ba5bb951e7f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265184.826311:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a1000030000/0x27274ba5bb951e7f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265184.826318:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a1000030000/0x27274ba5bb951e7f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265184.826323:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1000030000 already unused, calling callback (ffffffffc1581350) 00010000:00010000:2.0:1789265184.826327:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a1000030000/0x27274ba5bb951e7f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265184.826335:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a1000030000/0x27274ba5bb951e7f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265184.826418:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a1000030000/0x27274ba5bb951e7f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265184.826429:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265184.826574:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102e766d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c1230cd-a81b-4bcc-a532-e24f5353fef4+8:2351:x1876180397461504:12345-192.168.203.37@tcp:103: Request processed in 559us (5972us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265184.826581:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 20 00010000:00010000:3.0:1789265184.826658:0:8435:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a1000030000/0x27274ba5bb951e7f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265184.826668:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a1000030000/0x27274ba5bb951e7f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265184.826674:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1000030000/0x27274ba5bb951e7f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265184.847564:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265184.848432:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397461760 00000100:00100000:3.0:1789265184.848444:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397461760 00000100:00100000:3.0:1789265184.848498:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 129 00000100:00100000:3.0:1789265184.848509:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a100881f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1230cd-a81b-4bcc-a532-e24f5353fef4+8:5588:x1876180397461760:12345-192.168.203.37@tcp:101: 00010000:00010000:3.0:1789265184.848525:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265184.848545:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1000030000/0x27274ba5bb951e86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x73b61075d99efcf5 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265184.848571:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1000030000/0x27274ba5bb951e86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efcf5 expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265184.848593:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1000030000/0x27274ba5bb951e86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efcf5 expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265184.848603:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1000030000, rc 0) 00000100:00100000:3.0:1789265184.848663:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a100881f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1230cd-a81b-4bcc-a532-e24f5353fef4+9:5588:x1876180397461760:12345-192.168.203.37@tcp:101: Request processed in 155us (1109us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265184.848670:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 129 00000100:00100000:2.0:1789265184.858724:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265184.859018:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397461888 00000100:00100000:3.0:1789265184.859028:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397461888 00000100:00100000:3.0:1789265184.859102:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 130 00000100:00100000:3.0:1789265184.859114:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a100881d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+9:5588:x1876180397461888:12345-192.168.203.37@tcp:501: 00000100:00100000:3.0:1789265184.859563:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a100881d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+9:5588:x1876180397461888:12345-192.168.203.37@tcp:501: Request processed in 449us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265184.859571:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 130 00000100:00100000:1.0:1789265184.864137:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265184.864175:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397462016 00000100:00100000:1.0:1789265184.864183:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397462016 00000100:00100000:1.0:1789265184.864255:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 131 00000100:00100000:1.0:1789265184.864266:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a100881dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1230cd-a81b-4bcc-a532-e24f5353fef4+9:5588:x1876180397462016:12345-192.168.203.37@tcp:503: 00000100:00100000:1.0:1789265184.864479:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a100881dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1230cd-a81b-4bcc-a532-e24f5353fef4+9:5588:x1876180397462016:12345-192.168.203.37@tcp:503: Request processed in 214us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265184.864486:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 131 00000100:00100000:2.0:1789265184.867955:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265184.872421:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397462144 00000100:00100000:3.0:1789265184.872437:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397462144 00000100:00100000:3.0:1789265184.872506:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 132 00000100:00100000:3.0:1789265184.872517:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a100881fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1230cd-a81b-4bcc-a532-e24f5353fef4+9:6048:x1876180397462144:12345-192.168.203.37@tcp:502: 00000100:00100000:3.0:1789265184.872979:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a100881fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1230cd-a81b-4bcc-a532-e24f5353fef4+9:6048:x1876180397462144:12345-192.168.203.37@tcp:502: Request processed in 462us (5031us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265184.872990:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 132 00000100:00100000:0.0:1789265184.880715:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265184.880819:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397462272 00000100:00100000:1.0:1789265184.880830:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397462272 00000100:00100000:1.0:1789265184.880888:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 133 00000100:00100000:1.0:1789265184.880898:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a100881cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1230cd-a81b-4bcc-a532-e24f5353fef4+9:6048:x1876180397462272:12345-192.168.203.37@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789265184.881198:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a100881cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1230cd-a81b-4bcc-a532-e24f5353fef4+9:6048:x1876180397462272:12345-192.168.203.37@tcp:502:llog_process_th.0 Request processed in 301us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265184.881206:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 133 00000100:00100000:0.0:1789265184.892570:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265184.892806:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397462400 00000100:00100000:3.0:1789265184.892816:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397462400 00000100:00100000:3.0:1789265184.892870:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 134 00000100:00100000:3.0:1789265184.892880:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a100881f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1230cd-a81b-4bcc-a532-e24f5353fef4+9:5588:x1876180397462400:12345-192.168.203.37@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265184.892914:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265184.892932:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1000030e00/0x27274ba5bb951e8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x73b61075d99efcfc expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265184.892959:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1000030e00/0x27274ba5bb951e8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efcfc expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265184.892970:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1000030e00/0x27274ba5bb951e8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efcfc expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265184.892980:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1000030e00, rc 0) 00000100:00100000:3.0:1789265184.893042:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a100881f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1230cd-a81b-4bcc-a532-e24f5353fef4+10:5588:x1876180397462400:12345-192.168.203.37@tcp:101:ll_cfg_requeue.0 Request processed in 163us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265184.893049:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 134 00000100:00100000:1.0:1789265184.898351:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265184.898524:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397462528 00000100:00100000:3.0:1789265184.898536:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397462528 00000100:00100000:3.0:1789265184.898606:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 135 00000100:00100000:3.0:1789265184.898616:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a100881e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+10:5588:x1876180397462528:12345-192.168.203.37@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265184.898877:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a100881e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+10:5588:x1876180397462528:12345-192.168.203.37@tcp:501:ll_cfg_requeue.0 Request processed in 262us (533us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789265184.898887:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 135 00010000:00010000:2.0:1789265185.074255:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789265185.857240:0:8488:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe69a92d80 20000000:00000080:1.0:1789265185.857257:0:8488:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8a103f9ff400 uarg=0000000000000000 20000000:01000000:1.0:1789265185.857291:0:8488:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789265185.857296:0:8488:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789265185.857301:0:8488:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789265185.858676:0:8489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1789265185.858842:0:8488:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1789265185.863916:0:8488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1789265185.863973:0:8488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1789265185.864044:0:8488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1789265185.864287:0:8488:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789265185.864306:0:8488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a101b597400/0x27274ba5bb951e94 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265185.864324:0:8488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1017263400/0x27274ba5bb951c6b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb951c64 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265185.864353:0:8488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1017263200/0x27274ba5bb951ccd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb951cc6 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265185.864360:0:8488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1042045800/0x27274ba5bb951d98 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb951d91 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265185.864368:0:8488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a101b596000/0x27274ba5bb951e55 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efcc4 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265185.864376:0:8488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a101b597400/0x27274ba5bb951e94 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265185.864415:0:8488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a101b596000/0x27274ba5bb951e55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efcc4 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265185.864434:0:8488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a101b596000/0x27274ba5bb951e55 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efcc4 expref: 9 pid: 5834 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265185.864447:0:8488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1016d45c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8488:1876180414261888:192.168.203.37@tcp:104: 00010000:00010000:1.0:1789265185.864548:0:8488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1042045800/0x27274ba5bb951d98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27274ba5bb951d91 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265185.864557:0:8488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a1042045800/0x27274ba5bb951d98 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27274ba5bb951d91 expref: 11 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265185.864567:0:8488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1016d44380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8488:1876180414262016:0@lo:104: 00000100:00100000:1.0:1789265185.864605:0:8488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789265185.864654:0:8488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1017263200/0x27274ba5bb951ccd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27274ba5bb951cc6 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265185.864668:0:8488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a1017263200/0x27274ba5bb951ccd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27274ba5bb951cc6 expref: 11 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265185.864677:0:8488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1016d45500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8488:1876180414262144:0@lo:104: 00000100:00100000:1.0:1789265185.864702:0:8488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789265185.864723:0:8488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1017263400/0x27274ba5bb951c6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27274ba5bb951c64 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265185.864731:0:8488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a1017263400/0x27274ba5bb951c6b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27274ba5bb951c64 expref: 11 pid: 5834 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265185.864740:0:8488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1016d44e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8488:1876180414262272:0@lo:104: 00000100:00100000:1.0:1789265185.864757:0:8488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103bb4f780 going to sleep for 11 seconds 00000100:00100000:3.0:1789265185.864850:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789265185.864872:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265185.864886:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414262016 00000100:00100000:3.0:1789265185.864901:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414262016 00000100:00100000:3.0:1789265185.864941:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414262144 00000100:00100000:3.0:1789265185.864944:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414262144 00000100:00100000:2.0:1789265185.864960:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414262272 00000100:00100000:2.0:1789265185.864966:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414262272 00000100:00100000:3.0:1789265185.864973:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789265185.864985:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1016d46a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:871daf34-1206-40e7-bd71-78303abe4d37+5:8488:x1876180414262016:12345-0@lo:104: 00010000:00010000:3.0:1789265185.864997:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff8a101b596400/0x27274ba5bb951d91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x27274ba5bb951d98 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265185.865224:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789265185.865232:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1016d46a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:871daf34-1206-40e7-bd71-78303abe4d37+5:8488:x1876180414262016:12345-0@lo:104: Request processed in 251us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265185.865240:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789265185.865257:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789265185.865263:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102ede7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:871daf34-1206-40e7-bd71-78303abe4d37+4:8488:x1876180414262144:12345-0@lo:104: 00010000:00010000:2.0:1789265185.865272:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff8a101b597e00/0x27274ba5bb951cc6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x27274ba5bb951ccd expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265185.865304:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789265185.865309:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102ede7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:871daf34-1206-40e7-bd71-78303abe4d37+4:8488:x1876180414262144:12345-0@lo:104: Request processed in 47us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265185.865314:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789265185.865355:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789265185.865361:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102e766a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:871daf34-1206-40e7-bd71-78303abe4d37+3:8488:x1876180414262272:12345-0@lo:104: 00010000:00010000:2.0:1789265185.865368:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff8a101b596600/0x27274ba5bb951c64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x27274ba5bb951c6b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265185.865394:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789265185.865399:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102e766a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:871daf34-1206-40e7-bd71-78303abe4d37+3:8488:x1876180414262272:12345-0@lo:104: Request processed in 38us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265185.865405:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1789265185.865421:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789265185.865432:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff8a101b596400/0x27274ba5bb951d91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x27274ba5bb951d98 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265185.865439:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b596400 already unused, calling callback (ffffffffc1ba2c20) 10000000:00010000:2.0:1789265185.865443:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff8a101b596400/0x27274ba5bb951d91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x27274ba5bb951d98 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265185.865451:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff8a101b596400/0x27274ba5bb951d91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x27274ba5bb951d98 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265185.865457:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff8a101b596400/0x27274ba5bb951d91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x27274ba5bb951d98 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265185.865463:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789265185.865488:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff8a101b596400/0x27274ba5bb951d91 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951d98 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265185.865494:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265185.865512:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff8a101b596400/0x27274ba5bb951d91 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951d98 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265185.865520:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff8a101b596400/0x27274ba5bb951d91 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951d98 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265185.865532:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789265185.865536:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff8a101b597e00/0x27274ba5bb951cc6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x27274ba5bb951ccd expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265185.865542:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b597e00 already unused, calling callback (ffffffffc1ba2c20) 10000000:00010000:2.0:1789265185.865545:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff8a101b597e00/0x27274ba5bb951cc6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x27274ba5bb951ccd expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265185.865562:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff8a101b597e00/0x27274ba5bb951cc6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x27274ba5bb951ccd expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265185.865570:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff8a101b597e00/0x27274ba5bb951cc6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x27274ba5bb951ccd expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265185.865575:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789265185.865588:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff8a101b597e00/0x27274ba5bb951cc6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951ccd expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265185.865594:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265185.865599:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff8a101b597e00/0x27274ba5bb951cc6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951ccd expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265185.865606:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff8a101b597e00/0x27274ba5bb951cc6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951ccd expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265185.865615:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265185.865618:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff8a101b596600/0x27274ba5bb951c64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27274ba5bb951c6b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265185.865624:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b596600 already unused, calling callback (ffffffffc1ba2c20) 10000000:00010000:2.0:1789265185.865626:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff8a101b596600/0x27274ba5bb951c64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x27274ba5bb951c6b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265185.865632:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff8a101b596600/0x27274ba5bb951c64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x27274ba5bb951c6b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265185.865639:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff8a101b596600/0x27274ba5bb951c64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x27274ba5bb951c6b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265185.865650:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789265185.865663:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff8a101b596600/0x27274ba5bb951c64 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951c6b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265185.865669:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265185.865683:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff8a101b596600/0x27274ba5bb951c64 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951c6b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265185.865690:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff8a101b596600/0x27274ba5bb951c64 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951c6b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265185.865705:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265185.865706:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265185.865708:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265185.865720:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10349c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:871daf34-1206-40e7-bd71-78303abe4d37:3317:1876180414262400:0@lo:103: 00000100:00100000:2.0:1789265185.865746:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789265185.865765:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265185.865779:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789265185.865786:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10349c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:871daf34-1206-40e7-bd71-78303abe4d37:3317:1876180414262528:0@lo:103: 00000100:00100000:2.0:1789265185.865808:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265185.865814:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10349cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:871daf34-1206-40e7-bd71-78303abe4d37:3315:1876180414262656:0@lo:103: 00000100:00100000:2.0:1789265185.865841:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414262400 00000100:00100000:2.0:1789265185.865847:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414262400 00000100:00100000:3.0:1789265185.865852:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789265185.865867:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1042045800/0x27274ba5bb951d98 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27274ba5bb951d91 expref: 12 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265185.865884:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414262528 00000100:00100000:2.0:1789265185.865887:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414262528 00010000:00010000:2.0:1789265185.865910:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1017263200/0x27274ba5bb951ccd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27274ba5bb951cc6 expref: 13 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265185.865919:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414262656 00000100:00100000:3.0:1789265185.865925:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414262656 00000100:00100000:2.0:1789265185.865945:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1789265185.865946:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1017263400/0x27274ba5bb951c6b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27274ba5bb951c64 expref: 14 pid: 5834 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265185.865957:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10349cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:871daf34-1206-40e7-bd71-78303abe4d37+14:3317:x1876180414262400:12345-0@lo:103: 00000100:00100000:3.0:1789265185.865968:0:5826:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:2.0:1789265185.865968:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265185.865977:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1042045800/0x27274ba5bb951d98 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27274ba5bb951d91 expref: 14 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265185.865979:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:2.0:1789265185.865991:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1042045800/0x27274ba5bb951d98 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27274ba5bb951d91 expref: 14 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265185.866003:0:5825:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:2.0:1789265185.866009:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265185.866015:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789265185.866023:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10349ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:871daf34-1206-40e7-bd71-78303abe4d37+14:3317:x1876180414262528:12345-0@lo:103: 00010000:00010000:3.0:1789265185.866032:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265185.866037:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1017263200/0x27274ba5bb951ccd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27274ba5bb951cc6 expref: 14 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265185.866043:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10349cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:871daf34-1206-40e7-bd71-78303abe4d37+14:3317:x1876180414262400:12345-0@lo:103: Request processed in 89us (294us total) trans 0 rc 0/0 00010000:00010000:3.0:1789265185.866053:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1017263200/0x27274ba5bb951ccd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27274ba5bb951cc6 expref: 14 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265185.866057:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1789265185.866070:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265185.866100:0:5827:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789265185.866109:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789265185.866118:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102e764380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:871daf34-1206-40e7-bd71-78303abe4d37+13:3315:x1876180414262656:12345-0@lo:103: 00000100:00100000:3.0:1789265185.866126:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10349ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:871daf34-1206-40e7-bd71-78303abe4d37+13:3317:x1876180414262528:12345-0@lo:103: Request processed in 102us (315us total) trans 0 rc 0/0 00010000:00010000:2.0:1789265185.866127:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265185.866135:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1017263400/0x27274ba5bb951c6b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27274ba5bb951c64 expref: 13 pid: 5834 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265185.866138:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:2.0:1789265185.866147:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1017263400/0x27274ba5bb951c6b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27274ba5bb951c64 expref: 13 pid: 5834 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265185.866160:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265185.866194:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102e764380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:871daf34-1206-40e7-bd71-78303abe4d37+12:3315:x1876180414262656:12345-0@lo:103: Request processed in 78us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265185.866200:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789265185.866240:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10349cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:871daf34-1206-40e7-bd71-78303abe4d37:3315:1876180414262656:0@lo:103: 00000100:00100000:2.0:1789265185.866273:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10349c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:871daf34-1206-40e7-bd71-78303abe4d37:3317:1876180414262528:0@lo:103: 00000100:00100000:2.0:1789265185.866283:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10349c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:871daf34-1206-40e7-bd71-78303abe4d37:3317:1876180414262400:0@lo:103: 00010000:00010000:1.0:1789265185.866631:0:8488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1042045800/0x27274ba5bb951d98 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27274ba5bb951d91 expref: 11 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265185.866644:0:8488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1016d44380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8488:1876180414262016:0@lo:104: 00010000:00010000:1.0:1789265185.866656:0:8488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1017263200/0x27274ba5bb951ccd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27274ba5bb951cc6 expref: 10 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265185.866664:0:8488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1016d45500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8488:1876180414262144:0@lo:104: 00010000:00010000:1.0:1789265185.866673:0:8488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1017263400/0x27274ba5bb951c6b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27274ba5bb951c64 expref: 9 pid: 5834 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265185.866681:0:8488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1016d44e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8488:1876180414262272:0@lo:104: 00000100:00100000:1.0:1789265185.870304:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265185.870377:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397462656 00000100:00100000:2.0:1789265185.870386:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397462656 00010000:00010000:2.0:1789265185.870422:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a101b596000/0x27274ba5bb951e55 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efcc4 expref: 10 pid: 5834 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265185.870458:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 24 00000100:00100000:2.0:1789265185.870467:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1016d46680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c1230cd-a81b-4bcc-a532-e24f5353fef4+10:2350:x1876180397462656:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265185.870483:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265185.870489:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a101b596000/0x27274ba5bb951e55 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efcc4 expref: 10 pid: 5834 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265185.870503:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a101b596000/0x27274ba5bb951e55 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efcc4 expref: 10 pid: 5834 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265185.870525:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a101b597400/0x27274ba5bb951e94 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265185.870533:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a101b597400/0x27274ba5bb951e94 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265185.870548:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a101b597400/0x27274ba5bb951e94 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265185.870555:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a101b597400/0x27274ba5bb951e94 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265185.870578:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a101b597400/0x27274ba5bb951e94 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265185.870584:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a101b597400/0x27274ba5bb951e94 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265185.870590:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b597400 already unused, calling callback (ffffffffc1581350) 00010000:00010000:2.0:1789265185.870594:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a101b597400/0x27274ba5bb951e94 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265185.870602:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a101b597400/0x27274ba5bb951e94 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265185.870610:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a101b597400/0x27274ba5bb951e94 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265185.870620:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265185.870676:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1016d46680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c1230cd-a81b-4bcc-a532-e24f5353fef4+10:2350:x1876180397462656:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 209us (381us total) trans 0 rc 0/0 00010000:00010000:3.0:1789265185.870686:0:8488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a101b596000/0x27274ba5bb951e55 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efcc4 expref: 10 pid: 5834 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265185.870686:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 24 00000100:00100000:3.0:1789265185.870705:0:8488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1016d45c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8488:1876180414261888:192.168.203.37@tcp:104: 00010000:00010000:3.0:1789265185.870730:0:8488:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a101b597400/0x27274ba5bb951e94 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265185.870739:0:8488:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a101b597400/0x27274ba5bb951e94 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265185.870745:0:8488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a101b597400/0x27274ba5bb951e94 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265185.870752:0:8488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a101b597400/0x27274ba5bb951e94 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265186.098301:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789265186.139423:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789265186.139430:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a103bd8f000 from 39 10000000:01000000:3.0:1789265186.139435:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789265186.139484:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a1000031600/0x27274ba5bb951e9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265186.139495:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff8a1000031600/0x27274ba5bb951e9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265186.139506:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff8a1000031600/0x27274ba5bb951e9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265186.139530:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102e767100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414262784:0@lo:101: 00000100:00100000:3.0:1789265186.139603:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265186.139735:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10088b0f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789265186.141150:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414262784 00000100:00100000:1.0:1789265186.141174:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414262784 00000100:00100000:1.0:1789265186.141227:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789265186.141238:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a100881a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+9:5837:x1876180414262784:12345-0@lo:101: 00010000:00010000:1.0:1789265186.141253:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265186.141271:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a101b596a00/0x27274ba5bb951ea2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x27274ba5bb951e9b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265186.141297:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a101b596a00/0x27274ba5bb951ea2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27274ba5bb951e9b expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265186.141307:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a101b596a00/0x27274ba5bb951ea2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb951e9b expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265186.141315:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a101b596a00, rc 0) 00000100:00100000:1.0:1789265186.141387:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a100881a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+10:5837:x1876180414262784:12345-0@lo:101: Request processed in 151us (1783us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265186.141393:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789265186.142356:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102e767100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414262784:0@lo:101: 00010000:00010000:3.0:1789265186.142378:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff8a1000031600/0x27274ba5bb951e9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951ea2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265186.142389:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff8a1000031600/0x27274ba5bb951e9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27274ba5bb951ea2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265186.142457:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102e767100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414262912:0@lo:501: 00000100:00100000:3.0:1789265186.142498:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265186.142587:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414262912 00000100:00100000:2.0:1789265186.142593:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414262912 00000100:00100000:2.0:1789265186.142639:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789265186.142648:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a100881b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+10:5837:x1876180414262912:12345-0@lo:501: 00000100:00100000:2.0:1789265186.142917:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a100881b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+10:5837:x1876180414262912:12345-0@lo:501: Request processed in 268us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265186.142925:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789265186.145668:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10088b0f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789265186.145710:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102e767100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414262912:0@lo:501: 00000100:00100000:3.0:1789265186.145781:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102e767100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414263040:0@lo:503: 00000100:00100000:3.0:1789265186.145850:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265186.145946:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414263040 00000100:00100000:2.0:1789265186.145953:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414263040 00000100:00100000:2.0:1789265186.146017:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789265186.146027:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008818450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+10:5837:x1876180414263040:12345-0@lo:503: 00000100:00100000:2.0:1789265186.146218:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008818450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+10:5837:x1876180414263040:12345-0@lo:503: Request processed in 192us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265186.146226:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789265186.148269:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10088b0f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789265186.148311:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102e767100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414263040:0@lo:503: 00000100:00100000:0.0:1789265186.148744:0:8502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c07b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:8502:1876180414263168:0@lo:502: 00000100:00100000:0.0:1789265186.149051:0:8502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265186.149160:0:8502:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10107f2840 going to sleep for 11 seconds 00000100:00100000:3.0:1789265186.149242:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414263168 00000100:00100000:3.0:1789265186.149248:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414263168 00000100:00100000:3.0:1789265186.149334:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789265186.149344:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a100881b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+10:8502:x1876180414263168:12345-0@lo:502: 00000100:00100000:3.0:1789265186.149585:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a100881b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+10:8502:x1876180414263168:12345-0@lo:502: Request processed in 241us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265186.149592:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789265186.149670:0:8502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c07b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:8502:1876180414263168:0@lo:502: 00000100:00100000:0.0:1789265186.149714:0:8502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c07b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:8502:1876180414263296:0@lo:502: 00000100:00100000:0.0:1789265186.149760:0:8502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265186.150353:0:8502:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10107f2840 going to sleep for 11 seconds 00000100:00100000:2.0:1789265186.150424:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414263296 00000100:00100000:2.0:1789265186.150431:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414263296 00000100:00100000:2.0:1789265186.150461:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789265186.150469:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008819450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+10:8502:x1876180414263296:12345-0@lo:502: 00000100:00100000:2.0:1789265186.150641:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008819450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+10:8502:x1876180414263296:12345-0@lo:502: Request processed in 172us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265186.150648:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789265186.150730:0:8502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c07b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:8502:1876180414263296:0@lo:502: 00000040:00080000:0.0:1789265186.150774:0:8502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1789265186.151142:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1789265186.151163:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789265186.151172:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a1000031600/0x27274ba5bb951e9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951ea2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265186.151184:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff8a1000031600/0x27274ba5bb951e9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951ea2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265186.151193:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1789265186.151196:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1789265186.151199:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789265186.151225:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a103fad7800/0x27274ba5bb951ea9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265186.151233:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff8a103fad7800/0x27274ba5bb951ea9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265186.151251:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff8a103fad7800/0x27274ba5bb951ea9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265186.151264:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10349c9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414263424:0@lo:101: 00000100:00100000:2.0:1789265186.151292:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265186.151317:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103bc97a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789265186.151333:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414263424 00000100:00100000:3.0:1789265186.151339:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414263424 00000100:00100000:3.0:1789265186.151398:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789265186.151406:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008819c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+10:5837:x1876180414263424:12345-0@lo:101: 00010000:00010000:3.0:1789265186.151423:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265186.151435:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1000030a00/0x27274ba5bb951eb0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x27274ba5bb951ea9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265186.151457:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1000030a00/0x27274ba5bb951eb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27274ba5bb951ea9 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265186.151468:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1000030a00/0x27274ba5bb951eb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb951ea9 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265186.151476:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1000030a00, rc 0) 00000100:00100000:3.0:1789265186.151516:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008819c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+11:5837:x1876180414263424:12345-0@lo:101: Request processed in 112us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265186.151522:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789265186.151586:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10349c9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414263424:0@lo:101: 00010000:00010000:2.0:1789265186.151598:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff8a103fad7800/0x27274ba5bb951ea9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951eb0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265186.151606:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff8a103fad7800/0x27274ba5bb951ea9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x27274ba5bb951eb0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265186.151648:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10349c9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414263552:0@lo:501: 00000100:00100000:2.0:1789265186.151671:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265186.151727:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103bc97a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789265186.151867:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414263552 00000100:00100000:0.0:1789265186.151878:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414263552 00000100:00100000:0.0:1789265186.151910:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789265186.151917:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a100881bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+11:5837:x1876180414263552:12345-0@lo:501: 00000100:00100000:0.0:1789265186.152173:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a100881bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+11:5837:x1876180414263552:12345-0@lo:501: Request processed in 256us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265186.152180:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789265186.154403:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10349c9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414263552:0@lo:501: 00000100:00100000:2.0:1789265186.154462:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10349c9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414263680:0@lo:503: 00000100:00100000:2.0:1789265186.154533:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265186.154571:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103bc97a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789265186.154676:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414263680 00000100:00100000:0.0:1789265186.154682:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414263680 00000100:00100000:0.0:1789265186.154734:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789265186.154752:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008818c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+11:5837:x1876180414263680:12345-0@lo:503: 00000100:00100000:0.0:1789265186.155197:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008818c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+11:5837:x1876180414263680:12345-0@lo:503: Request processed in 454us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265186.155204:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789265186.155471:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10349c9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414263680:0@lo:503: 00000100:00100000:0.0:1789265186.157370:0:8503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c07b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:8503:1876180414263808:0@lo:502: 00000100:00100000:0.0:1789265186.157450:0:8503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265186.157498:0:8503:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10107f2a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789265186.157695:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414263808 00000100:00100000:1.0:1789265186.157701:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414263808 00000100:00100000:1.0:1789265186.157753:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789265186.157762:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a100881b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+11:8503:x1876180414263808:12345-0@lo:502: 00000100:00100000:1.0:1789265186.158006:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a100881b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+11:8503:x1876180414263808:12345-0@lo:502: Request processed in 245us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265186.158014:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789265186.158120:0:8503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c07b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:8503:1876180414263808:0@lo:502: 00000020:01000000:0.0:1789265186.158149:0:8503:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789265186.158158:0:8503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265186.158160:0:8503:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789265186.158168:0:8503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789265186.158189:0:8503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c07b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:8503:1876180414263936:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789265186.158222:0:8503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265186.158255:0:8503:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1004df9f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789265186.158438:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414263936 00000100:00100000:3.0:1789265186.158454:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414263936 00000100:00100000:3.0:1789265186.158490:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789265186.158499:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a100881a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+11:8503:x1876180414263936:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265186.158652:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a100881a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+11:8503:x1876180414263936:12345-0@lo:502:llog_process_th.0 Request processed in 154us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265186.158659:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789265186.158734:0:8503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c07b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:8503:1876180414263936:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789265186.158774:0:8503:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789265186.158786:0:8503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265186.158788:0:8503:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789265186.158794:0:8503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1789265186.159259:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1789265186.159280:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789265186.159288:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a103fad7800/0x27274ba5bb951ea9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951eb0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265186.159299:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff8a103fad7800/0x27274ba5bb951ea9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951eb0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265186.159316:0:5837:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789265186.159318:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a103bd8f000 from 4 10000000:01000000:3.0:1789265186.159321:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789265186.159350:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a1000031e00/0x27274ba5bb951eb7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265186.159359:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff8a1000031e00/0x27274ba5bb951eb7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265186.159368:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff8a1000031e00/0x27274ba5bb951eb7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265186.159384:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102e767100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414264064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789265186.159422:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265186.159459:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10202c2540 going to sleep for 11 seconds 00000100:00100000:1.0:1789265186.159515:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414264064 00000100:00100000:1.0:1789265186.159520:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414264064 00000100:00100000:1.0:1789265186.159552:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789265186.159559:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008819850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+11:5837:x1876180414264064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789265186.159568:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265186.159585:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a101b596e00/0x27274ba5bb951ebe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27274ba5bb951eb7 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265186.159606:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a101b596e00/0x27274ba5bb951ebe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27274ba5bb951eb7 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265186.159616:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a101b596e00/0x27274ba5bb951ebe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb951eb7 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265186.159624:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a101b596e00, rc 0) 00000100:00100000:1.0:1789265186.159660:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008819850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+12:5837:x1876180414264064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265186.159666:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789265186.159777:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102e767100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414264064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265186.159789:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff8a1000031e00/0x27274ba5bb951eb7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951ebe expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265186.159798:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff8a1000031e00/0x27274ba5bb951eb7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27274ba5bb951ebe expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265186.159841:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102e767100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414264192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265186.159875:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265186.159984:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10202c2540 going to sleep for 11 seconds 00000100:00100000:0.0:1789265186.160428:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414264192 00000100:00100000:0.0:1789265186.160434:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414264192 00000100:00100000:0.0:1789265186.160458:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789265186.160465:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008818050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+12:5837:x1876180414264192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789265186.160711:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008818050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+12:5837:x1876180414264192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 245us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265186.160719:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789265186.161062:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102e767100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414264192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265186.161137:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102e767100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414264320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789265186.161190:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265186.161264:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10202c2540 going to sleep for 11 seconds 00000100:00100000:2.0:1789265186.161322:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414264320 00000100:00100000:2.0:1789265186.161327:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414264320 00000100:00100000:2.0:1789265186.161361:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789265186.161369:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a100881a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+12:5837:x1876180414264320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265186.161534:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a100881a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+12:5837:x1876180414264320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 165us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265186.161546:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789265186.161619:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102e767100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414264320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789265186.162362:0:8504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102e767100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:8504:1876180414264448:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265186.162407:0:8504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265186.162548:0:8504:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10202c2180 going to sleep for 11 seconds 00000100:00100000:2.0:1789265186.167253:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414264448 00000100:00100000:2.0:1789265186.167269:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414264448 00000100:00100000:2.0:1789265186.167414:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789265186.167424:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008818850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+12:8504:x1876180414264448:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265186.167785:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008818850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+12:8504:x1876180414264448:12345-0@lo:502:llog_process_th.0 Request processed in 361us (5375us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265186.167793:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789265186.169650:0:8504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102e767100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:8504:1876180414264448:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789265186.169698:0:8504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265186.169711:0:8504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265186.169713:0:8504:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789265186.169720:0:8504:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a103bd8f000 00000020:00000080:3.0:1789265186.169723:0:8504:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789265186.169881:0:8504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102e767100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:8504:1876180414264576:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265186.169969:0:8504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265186.170026:0:8504:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10202c2180 going to sleep for 11 seconds 00000100:00100000:1.0:1789265186.170027:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414264576 00000100:00100000:1.0:1789265186.170034:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414264576 00000100:00100000:1.0:1789265186.170110:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789265186.170119:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a100881ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+12:8504:x1876180414264576:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789265186.170322:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a100881ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+12:8504:x1876180414264576:12345-0@lo:502:llog_process_th.0 Request processed in 203us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265186.170328:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789265186.170431:0:8504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102e767100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:8504:1876180414264576:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789265186.170451:0:8504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265186.170456:0:8504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265186.170457:0:8504:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1789265186.170461:0:8504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1789265186.170627:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1789265186.170643:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789265186.170658:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a1000031e00/0x27274ba5bb951eb7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951ebe expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265186.170669:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff8a1000031e00/0x27274ba5bb951eb7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951ebe expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265186.170677:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789265186.170685:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a103c151000 from 39 10000000:01000000:1.0:1789265186.170689:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789265186.170713:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a101b597400/0x27274ba5bb951ec5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265186.170721:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff8a101b597400/0x27274ba5bb951ec5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265186.170730:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff8a101b597400/0x27274ba5bb951ec5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265186.170742:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1016d44700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414264704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789265186.170781:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265186.170809:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103bb4f000 going to sleep for 11 seconds 00000100:00100000:3.0:1789265186.170856:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414264704 00000100:00100000:3.0:1789265186.170861:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414264704 00000100:00100000:3.0:1789265186.170903:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789265186.170911:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008819050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+12:5837:x1876180414264704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265186.170920:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265186.170931:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1000030400/0x27274ba5bb951ecc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x27274ba5bb951ec5 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265186.170959:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1000030400/0x27274ba5bb951ecc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27274ba5bb951ec5 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265186.170969:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1000030400/0x27274ba5bb951ecc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb951ec5 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265186.170977:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1000030400, rc 0) 00000100:00100000:3.0:1789265186.171007:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008819050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+13:5837:x1876180414264704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265186.171012:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789265186.171096:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1016d44700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414264704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789265186.171108:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff8a101b597400/0x27274ba5bb951ec5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951ecc expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265186.171118:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff8a101b597400/0x27274ba5bb951ec5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x27274ba5bb951ecc expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265186.171157:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1016d44700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414264832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265186.171180:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265186.171197:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103bb4f000 going to sleep for 11 seconds 00000100:00100000:2.0:1789265186.171260:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414264832 00000100:00100000:2.0:1789265186.171264:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414264832 00000100:00100000:2.0:1789265186.171290:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789265186.171296:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+13:5837:x1876180414264832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265186.171481:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+13:5837:x1876180414264832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 185us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265186.171645:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1016d44700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414264832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265186.171672:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1016d44700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414264960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789265186.171707:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265186.171726:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103bb4f000 going to sleep for 11 seconds 00000100:00100000:1.0:1789265186.171742:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414264960 00000100:00100000:1.0:1789265186.171746:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414264960 00000100:00100000:1.0:1789265186.171762:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789265186.171768:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+14:5837:x1876180414264960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789265186.171908:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+14:5837:x1876180414264960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 139us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265186.171915:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789265186.171953:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1016d44700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414264960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789265186.172133:0:8505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1016d44700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:8505:1876180414265088:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789265186.172166:0:8505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265186.172189:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414265088 00000100:00100000:1.0:1789265186.172194:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414265088 00000100:00100000:1.0:1789265186.172214:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789265186.172220:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+14:8505:x1876180414265088:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265186.172741:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789265186.174146:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+13:8505:x1876180414265088:12345-0@lo:502:llog_process_th.0 Request processed in 1919us (1973us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265186.174156:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789265186.174223:0:8505:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103bb4f240 going to sleep for 11 seconds 00000100:00100000:1.0:1789265186.174244:0:8505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1016d44700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:8505:1876180414265088:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789265186.174303:0:8505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1016d44700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:8505:1876180414265216:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789265186.174341:0:8505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265186.174365:0:8505:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103bb4f240 going to sleep for 11 seconds 00000100:00100000:3.0:1789265186.174458:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414265216 00000100:00100000:3.0:1789265186.174465:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414265216 00000100:00100000:3.0:1789265186.174507:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789265186.174516:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+13:8505:x1876180414265216:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265186.174642:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+13:8505:x1876180414265216:12345-0@lo:502:llog_process_th.0 Request processed in 126us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265186.174649:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789265186.174868:0:8505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1016d44700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:8505:1876180414265216:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789265186.174889:0:8505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1789265186.175326:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1789265186.175344:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789265186.175354:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a101b597400/0x27274ba5bb951ec5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951ecc expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265186.175365:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff8a101b597400/0x27274ba5bb951ec5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951ecc expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265186.175374:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1789265186.175377:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1789265186.175387:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789265186.175417:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a1042045800/0x27274ba5bb951ed3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265186.175424:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff8a1042045800/0x27274ba5bb951ed3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265186.175433:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff8a1042045800/0x27274ba5bb951ed3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265186.175449:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102e767100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414265344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789265186.175503:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265186.175525:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10202c23c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265186.175705:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414265344 00000100:00100000:1.0:1789265186.175711:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414265344 00000100:00100000:1.0:1789265186.175746:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789265186.175754:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+13:5837:x1876180414265344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789265186.175772:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265186.175783:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a101b596000/0x27274ba5bb951eda lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x27274ba5bb951ed3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265186.175805:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a101b596000/0x27274ba5bb951eda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27274ba5bb951ed3 expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265186.175816:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a101b596000/0x27274ba5bb951eda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb951ed3 expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265186.175823:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a101b596000, rc 0) 00000100:00100000:1.0:1789265186.175853:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+14:5837:x1876180414265344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265186.175859:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789265186.176183:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102e767100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414265344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265186.176203:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff8a1042045800/0x27274ba5bb951ed3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951eda expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265186.176214:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff8a1042045800/0x27274ba5bb951ed3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x27274ba5bb951eda expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265186.176274:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102e767100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414265472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265186.176308:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265186.176332:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10202c23c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265186.176345:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414265472 00000100:00100000:3.0:1789265186.176348:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414265472 00000100:00100000:3.0:1789265186.176379:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789265186.176386:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+14:5837:x1876180414265472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265186.176630:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+14:5837:x1876180414265472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 244us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265186.176641:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789265186.176671:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102e767100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414265472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265186.176694:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102e767100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414265600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789265186.176727:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265186.176740:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10202c23c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265186.176751:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414265600 00000100:00100000:3.0:1789265186.176755:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414265600 00000100:00100000:3.0:1789265186.176983:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789265186.176991:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+14:5837:x1876180414265600:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789265186.177147:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+14:5837:x1876180414265600:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 157us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265186.177153:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789265186.179154:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102e767100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414265600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789265186.184637:0:8507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c07b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:8507:1876180414265728:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789265186.184731:0:8507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265186.184783:0:8507:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10107f2a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789265186.184974:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414265728 00000100:00100000:1.0:1789265186.184982:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414265728 00000100:00100000:1.0:1789265186.185036:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789265186.185045:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+14:8507:x1876180414265728:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789265186.185270:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+14:8507:x1876180414265728:12345-0@lo:502:llog_process_th.0 Request processed in 226us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265186.185278:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789265186.188549:0:8507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c07b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:8507:1876180414265728:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789265186.188600:0:8507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789265186.188613:0:8507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265186.188615:0:8507:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789265186.188626:0:8507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789265186.188665:0:8507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c07b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:8507:1876180414265856:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789265186.188739:0:8507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265186.188793:0:8507:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1004df9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789265186.188938:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414265856 00000100:00100000:2.0:1789265186.188945:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414265856 00000100:00100000:2.0:1789265186.188992:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789265186.189002:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+14:8507:x1876180414265856:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265186.190517:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+14:8507:x1876180414265856:12345-0@lo:502:llog_process_th.0 Request processed in 1510us (1771us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265186.190528:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789265186.191673:0:8507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c07b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:8507:1876180414265856:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789265186.191716:0:8507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789265186.191725:0:8507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265186.191728:0:8507:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789265186.191738:0:8507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:2.0:1789265186.191994:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1789265186.192019:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789265186.192037:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a1042045800/0x27274ba5bb951ed3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951eda expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265186.192048:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff8a1042045800/0x27274ba5bb951ed3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951eda expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265186.192057:0:5837:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789265186.192060:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a103c151000 from 4 10000000:01000000:2.0:1789265186.192063:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789265186.192175:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a103fad6200/0x27274ba5bb951ee1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265186.192183:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff8a103fad6200/0x27274ba5bb951ee1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265186.192193:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff8a103fad6200/0x27274ba5bb951ee1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265186.192565:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10349c9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414265984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789265186.192633:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265186.195179:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103bc97780 going to sleep for 11 seconds 00000100:00100000:0.0:1789265186.198359:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414265984 00000100:00100000:0.0:1789265186.198374:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414265984 00000100:00100000:0.0:1789265186.198446:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789265186.198456:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+14:5837:x1876180414265984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789265186.198472:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265186.198501:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1017262400/0x27274ba5bb951ee8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x27274ba5bb951ee1 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265186.198530:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1017262400/0x27274ba5bb951ee8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27274ba5bb951ee1 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265186.198542:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1017262400/0x27274ba5bb951ee8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb951ee1 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265186.198551:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1017262400, rc 0) 00000100:00100000:0.0:1789265186.198633:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+15:5837:x1876180414265984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 180us (6001us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265186.198640:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789265186.198704:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10349c9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414265984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789265186.198722:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff8a103fad6200/0x27274ba5bb951ee1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951ee8 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265186.198732:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff8a103fad6200/0x27274ba5bb951ee1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x27274ba5bb951ee8 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265186.199322:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c07b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414266112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789265186.199358:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265186.199394:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1004df9480 going to sleep for 11 seconds 00000100:00100000:2.0:1789265186.199711:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414266112 00000100:00100000:2.0:1789265186.199717:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414266112 00000100:00100000:2.0:1789265186.199766:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789265186.199776:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+15:5837:x1876180414266112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265186.200221:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+15:5837:x1876180414266112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 445us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265186.200230:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789265186.201333:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c07b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414266112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789265186.201394:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c07b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414266240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789265186.201452:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265186.201485:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1004df9480 going to sleep for 11 seconds 00000100:00100000:0.0:1789265186.201505:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414266240 00000100:00100000:0.0:1789265186.201510:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414266240 00000100:00100000:0.0:1789265186.201550:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789265186.201558:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+15:5837:x1876180414266240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789265186.201736:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+15:5837:x1876180414266240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 178us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265186.201743:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789265186.201847:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c07b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414266240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265186.202163:0:8509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10349cbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:8509:1876180414266368:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265186.202209:0:8509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265186.202230:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414266368 00000100:00100000:2.0:1789265186.202244:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414266368 00000100:00100000:2.0:1789265186.202264:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789265186.202271:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+15:8509:x1876180414266368:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265186.202393:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+15:8509:x1876180414266368:12345-0@lo:502:llog_process_th.0 Request processed in 122us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265186.202399:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789265186.202431:0:8509:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103bc97b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789265186.202442:0:8509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10349cbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:8509:1876180414266368:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789265186.202463:0:8509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789265186.202471:0:8509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265186.202473:0:8509:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789265186.202481:0:8509:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a103c151000 00000020:00000080:2.0:1789265186.202483:0:8509:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789265186.202778:0:8509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10349cbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:8509:1876180414266496:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265186.202811:0:8509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265186.202829:0:8509:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103bc97b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789265186.203952:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414266496 00000100:00100000:0.0:1789265186.203962:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414266496 00000100:00100000:0.0:1789265186.204004:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789265186.204012:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+15:8509:x1876180414266496:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789265186.204946:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+15:8509:x1876180414266496:12345-0@lo:502:llog_process_th.0 Request processed in 931us (2130us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265186.204954:0:8509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10349cbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:8509:1876180414266496:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789265186.204955:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000020:01000000:2.0:1789265186.204987:0:8509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265186.204994:0:8509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265186.204996:0:8509:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789265186.205002:0:8509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1789265186.205121:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1789265186.205141:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789265186.205152:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a103fad6200/0x27274ba5bb951ee1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951ee8 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265186.205163:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff8a103fad6200/0x27274ba5bb951ee1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951ee8 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265186.205172:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789265186.205174:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a10202ad000 from 39 10000000:01000000:3.0:1789265186.205177:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789265186.205212:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a1042045a00/0x27274ba5bb951eef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265186.205219:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff8a1042045a00/0x27274ba5bb951eef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265186.205237:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff8a1042045a00/0x27274ba5bb951eef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265186.205256:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102e767b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414266624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789265186.205295:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265186.205329:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a0f03ba9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789265186.205981:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414266624 00000100:00100000:2.0:1789265186.205988:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414266624 00000100:00100000:2.0:1789265186.206044:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789265186.206053:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+15:5837:x1876180414266624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789265186.206065:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265186.206098:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a103fad7200/0x27274ba5bb951ef6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x27274ba5bb951eef expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265186.206123:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a103fad7200/0x27274ba5bb951ef6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27274ba5bb951eef expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265186.206134:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a103fad7200/0x27274ba5bb951ef6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb951eef expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265186.206143:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fad7200, rc 0) 00000100:00100000:2.0:1789265186.206209:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+16:5837:x1876180414266624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (912us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265186.206215:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789265186.206315:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102e767b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414266624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789265186.206330:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff8a1042045a00/0x27274ba5bb951eef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951ef6 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265186.206349:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff8a1042045a00/0x27274ba5bb951eef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x27274ba5bb951ef6 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265186.206406:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1016d44700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414266752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265186.206435:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265186.206467:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103bb4f000 going to sleep for 11 seconds 00000100:00100000:2.0:1789265186.206518:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414266752 00000100:00100000:2.0:1789265186.206523:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414266752 00000100:00100000:2.0:1789265186.206557:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789265186.206563:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+16:5837:x1876180414266752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265186.206798:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+16:5837:x1876180414266752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 234us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265186.206806:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789265186.207067:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1016d44700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414266752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265186.207293:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1016d44700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414266880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789265186.207332:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265186.207359:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103bb4f000 going to sleep for 11 seconds 00000100:00100000:2.0:1789265186.207398:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414266880 00000100:00100000:2.0:1789265186.207402:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414266880 00000100:00100000:2.0:1789265186.207472:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789265186.207481:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+16:5837:x1876180414266880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265186.207632:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+16:5837:x1876180414266880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 152us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265186.207645:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789265186.209604:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1016d44700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414266880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789265186.210032:0:8510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1016d44700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:8510:1876180414267008:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789265186.210122:0:8510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265186.210158:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414267008 00000100:00100000:1.0:1789265186.210163:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414267008 00000100:00100000:1.0:1789265186.210195:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1789265186.210203:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+16:8510:x1876180414267008:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789265186.210702:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+16:8510:x1876180414267008:12345-0@lo:502:llog_process_th.0 Request processed in 497us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265186.210711:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1789265186.210768:0:8510:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103bb4f780 going to sleep for 11 seconds 00000100:00100000:1.0:1789265186.210796:0:8510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1016d44700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:8510:1876180414267008:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789265186.210858:0:8510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1016d44700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:8510:1876180414267136:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789265186.210914:0:8510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265186.210938:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414267136 00000100:00100000:1.0:1789265186.210942:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414267136 00000100:00100000:1.0:1789265186.211176:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789265186.211185:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+16:8510:x1876180414267136:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789265186.211690:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+16:8510:x1876180414267136:12345-0@lo:502:llog_process_th.0 Request processed in 505us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265186.211698:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789265186.211735:0:8510:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103bb4f780 going to sleep for 11 seconds 00000100:00100000:1.0:1789265186.211749:0:8510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1016d44700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:8510:1876180414267136:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789265186.211773:0:8510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1789265186.211854:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1789265186.211874:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789265186.211886:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a1042045a00/0x27274ba5bb951eef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951ef6 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265186.211907:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff8a1042045a00/0x27274ba5bb951eef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951ef6 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265186.211916:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789265186.211918:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1789265186.211928:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789265186.211955:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a1017262000/0x27274ba5bb951efd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265186.211963:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff8a1017262000/0x27274ba5bb951efd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265186.211972:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff8a1017262000/0x27274ba5bb951efd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265186.211987:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c078000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414267264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789265186.212018:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265186.212043:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10107f2000 going to sleep for 11 seconds 00000100:00100000:1.0:1789265186.212148:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414267264 00000100:00100000:1.0:1789265186.212155:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414267264 00000100:00100000:1.0:1789265186.212179:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1789265186.212186:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+16:5837:x1876180414267264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789265186.212197:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265186.212210:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a101b597600/0x27274ba5bb951f04 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x27274ba5bb951efd expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265186.212233:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a101b597600/0x27274ba5bb951f04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27274ba5bb951efd expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265186.212243:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a101b597600/0x27274ba5bb951f04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb951efd expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265186.212252:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a101b597600, rc 0) 00000100:00100000:1.0:1789265186.212285:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+17:5837:x1876180414267264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265186.212297:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1789265186.212516:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c078000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414267264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789265186.212529:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff8a1017262000/0x27274ba5bb951efd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951f04 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265186.212538:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff8a1017262000/0x27274ba5bb951efd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x27274ba5bb951f04 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265186.212580:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1016d44700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414267392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265186.212605:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265186.212625:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103bb4f480 going to sleep for 11 seconds 00000100:00100000:1.0:1789265186.212638:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414267392 00000100:00100000:1.0:1789265186.212641:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414267392 00000100:00100000:1.0:1789265186.212658:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1789265186.212664:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+17:5837:x1876180414267392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265186.213203:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+17:5837:x1876180414267392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 536us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265186.213211:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1789265186.213250:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1016d44700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414267392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265186.213283:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1016d44700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414267520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789265186.213502:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265186.213528:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103bb4f480 going to sleep for 11 seconds 00000100:00100000:1.0:1789265186.213543:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414267520 00000100:00100000:1.0:1789265186.213547:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414267520 00000100:00100000:1.0:1789265186.213567:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1789265186.213581:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+17:5837:x1876180414267520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789265186.213745:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+17:5837:x1876180414267520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 164us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265186.213752:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1789265186.214436:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1016d44700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414267520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789265186.214621:0:8511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1016d44700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:8511:1876180414267648:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789265186.214669:0:8511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265186.214695:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414267648 00000100:00100000:1.0:1789265186.214700:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414267648 00000100:00100000:1.0:1789265186.214723:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1789265186.214731:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+17:8511:x1876180414267648:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265186.215351:0:8511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a100914acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265186.215571:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+17:8511:x1876180414267648:12345-0@lo:502:llog_process_th.0 Request processed in 839us (900us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265186.215581:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789265186.215638:0:8511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1016d44700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:8511:1876180414267648:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789265186.215666:0:8511:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789265186.215675:0:8511:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265186.215677:0:8511:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789265186.215685:0:8511:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789265186.215710:0:8511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10349cbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:8511:1876180414267776:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265186.215750:0:8511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265186.215776:0:8511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103bc97240 going to sleep for 11 seconds 00000100:00100000:1.0:1789265186.215868:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414267776 00000100:00100000:1.0:1789265186.215873:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414267776 00000100:00100000:1.0:1789265186.215946:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1789265186.215955:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+17:8511:x1876180414267776:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789265186.216130:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+17:8511:x1876180414267776:12345-0@lo:502:llog_process_th.0 Request processed in 175us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265186.216137:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1789265186.222689:0:8511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10349cbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:8511:1876180414267776:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789265186.222737:0:8511:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265186.222744:0:8511:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265186.222746:0:8511:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789265186.222752:0:8511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1789265186.222921:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:1.0:1789265186.222940:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789265186.222951:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a1017262000/0x27274ba5bb951efd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951f04 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265186.222974:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff8a1017262000/0x27274ba5bb951efd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951f04 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265186.222984:0:5837:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789265186.222987:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a10202ad000 from 4 10000000:01000000:1.0:1789265186.222990:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789265186.223026:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a101b596600/0x27274ba5bb951f0b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265186.223035:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff8a101b596600/0x27274ba5bb951f0b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265186.223045:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff8a101b596600/0x27274ba5bb951f0b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265186.223066:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1016d44000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414267904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789265186.223157:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265186.223203:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a100914ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1789265186.223388:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414267904 00000100:00100000:2.0:1789265186.223396:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414267904 00000100:00100000:2.0:1789265186.223446:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1789265186.223455:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+17:5837:x1876180414267904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789265186.223468:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265186.223480:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a103fad6600/0x27274ba5bb951f12 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x27274ba5bb951f0b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265186.223513:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a103fad6600/0x27274ba5bb951f12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27274ba5bb951f0b expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265186.223524:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a103fad6600/0x27274ba5bb951f12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb951f0b expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265186.223540:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fad6600, rc 0) 00000100:00100000:2.0:1789265186.223589:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+18:5837:x1876180414267904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265186.223596:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1789265186.223619:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1016d44000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414267904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789265186.223631:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff8a101b596600/0x27274ba5bb951f0b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951f12 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265186.223640:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff8a101b596600/0x27274ba5bb951f0b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x27274ba5bb951f12 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265186.223690:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c078380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414268032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789265186.223718:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265186.223744:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10107f2000 going to sleep for 11 seconds 00000100:00100000:2.0:1789265186.223825:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414268032 00000100:00100000:2.0:1789265186.223829:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414268032 00000100:00100000:2.0:1789265186.223858:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1789265186.223866:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+18:5837:x1876180414268032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265186.224161:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+18:5837:x1876180414268032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 294us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265186.224168:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789265186.224632:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c078380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414268032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789265186.224664:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c078380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414268160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789265186.224701:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265186.224733:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10107f2000 going to sleep for 11 seconds 00000100:00100000:2.0:1789265186.226219:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414268160 00000100:00100000:2.0:1789265186.226230:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414268160 00000100:00100000:2.0:1789265186.226283:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1789265186.226293:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+18:5837:x1876180414268160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265186.226508:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+18:5837:x1876180414268160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 216us (1805us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265186.226515:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789265186.226650:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c078380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414268160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789265186.227547:0:8513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c078380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:8513:1876180414268288:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789265186.227605:0:8513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265186.227638:0:8513:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a102eb77240 going to sleep for 11 seconds 00000100:00100000:2.0:1789265186.233720:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414268288 00000100:00100000:2.0:1789265186.233733:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414268288 00000100:00100000:2.0:1789265186.233799:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1789265186.233809:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+18:8513:x1876180414268288:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265186.234067:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+18:8513:x1876180414268288:12345-0@lo:502:llog_process_th.0 Request processed in 258us (6460us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265186.234092:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789265186.234154:0:8513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c078380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:8513:1876180414268288:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789265186.234191:0:8513:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789265186.234209:0:8513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265186.234212:0:8513:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789265186.234223:0:8513:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a10202ad000 00000020:00000080:0.0:1789265186.234226:0:8513:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789265186.234314:0:8513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c078380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:8513:1876180414268416:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789265186.234355:0:8513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265186.234390:0:8513:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a102eb77240 going to sleep for 11 seconds 00000100:00100000:2.0:1789265186.234888:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414268416 00000100:00100000:2.0:1789265186.234904:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414268416 00000100:00100000:2.0:1789265186.234942:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1789265186.234951:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+18:8513:x1876180414268416:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265186.235122:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+18:8513:x1876180414268416:12345-0@lo:502:llog_process_th.0 Request processed in 171us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265186.235133:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1789265186.235163:0:8513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c078380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:8513:1876180414268416:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789265186.235186:0:8513:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789265186.235192:0:8513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265186.235194:0:8513:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1789265186.235208:0:8513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789265186.235519:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789265186.235535:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789265186.235544:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a101b596600/0x27274ba5bb951f0b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951f12 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265186.235556:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff8a101b596600/0x27274ba5bb951f0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951f12 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265186.235565:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789265186.235568:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8a10087899b8 from 1 10000000:01000000:2.0:1789265186.235570:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789265186.235592:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a103fad7c00/0x27274ba5bb951f19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265186.235600:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff8a103fad7c00/0x27274ba5bb951f19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265186.235609:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff8a103fad7c00/0x27274ba5bb951f19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265186.235623:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10349cbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414268544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789265186.235651:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265186.235688:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103bc97180 going to sleep for 11 seconds 00000100:00100000:1.0:1789265186.236172:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414268544 00000100:00100000:1.0:1789265186.236178:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414268544 00000100:00100000:1.0:1789265186.236222:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1789265186.236231:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+18:5837:x1876180414268544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789265186.236241:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265186.236252:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a101b597e00/0x27274ba5bb951f20 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x27274ba5bb951f19 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265186.236272:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a101b597e00/0x27274ba5bb951f20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27274ba5bb951f19 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265186.236293:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a101b597e00/0x27274ba5bb951f20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb951f19 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265186.236302:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a101b597e00, rc 0) 00000100:00100000:1.0:1789265186.236334:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+19:5837:x1876180414268544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265186.236340:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1789265186.236453:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10349cbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414268544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789265186.236466:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff8a103fad7c00/0x27274ba5bb951f19 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951f20 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265186.236475:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff8a103fad7c00/0x27274ba5bb951f19 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x27274ba5bb951f20 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265186.236533:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10349cbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414268672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265186.236556:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265186.236574:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103bc97180 going to sleep for 11 seconds 00000100:00100000:1.0:1789265186.236842:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414268672 00000100:00100000:1.0:1789265186.236846:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414268672 00000100:00100000:1.0:1789265186.236873:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1789265186.236879:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+19:5837:x1876180414268672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265186.237070:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+19:5837:x1876180414268672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 190us (512us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789265186.237096:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1789265186.237157:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10349cbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414268672:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1789265186.237178:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789265186.237184:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a103fad7c00/0x27274ba5bb951f19 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951f20 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265186.237201:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff8a103fad7c00/0x27274ba5bb951f19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951f20 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265186.356384:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265186.356476:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397462784 00000100:00100000:0.0:1789265186.356495:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397462784 00000100:00100000:0.0:1789265186.356557:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 183 00000100:00100000:0.0:1789265186.356567:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1230cd-a81b-4bcc-a532-e24f5353fef4+9:5588:x1876180397462784:12345-192.168.203.37@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789265186.356584:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265186.356602:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1017262e00/0x27274ba5bb951f27 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x73b61075d99efd03 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265186.356630:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1017262e00/0x27274ba5bb951f27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efd03 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265186.356656:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1017262e00/0x27274ba5bb951f27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efd03 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265186.356665:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1017262e00, rc 0) 00000100:00100000:0.0:1789265186.356721:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1230cd-a81b-4bcc-a532-e24f5353fef4+10:5588:x1876180397462784:12345-192.168.203.37@tcp:101:ll_cfg_requeue.0 Request processed in 157us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265186.356728:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 183 00000100:00100000:0.0:1789265186.366501:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265186.370041:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397462912 00000100:00100000:2.0:1789265186.370059:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397462912 00000100:00100000:2.0:1789265186.370171:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 184 00000100:00100000:2.0:1789265186.370182:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10119dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1230cd-a81b-4bcc-a532-e24f5353fef4+10:5588:x1876180397462912:12345-192.168.203.37@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265186.370466:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10119dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1230cd-a81b-4bcc-a532-e24f5353fef4+10:5588:x1876180397462912:12345-192.168.203.37@tcp:501:ll_cfg_requeue.0 Request processed in 285us (3973us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265186.370475:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 184 00000100:00100000:2.0:1789265186.373548:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265186.373652:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397463040 00000100:00100000:1.0:1789265186.373663:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397463040 00000100:00100000:1.0:1789265186.373723:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 185 00000100:00100000:1.0:1789265186.373733:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10119ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+10:5588:x1876180397463040:12345-192.168.203.37@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789265186.373975:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10119ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+10:5588:x1876180397463040:12345-192.168.203.37@tcp:503:ll_cfg_requeue.0 Request processed in 242us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265186.373983:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 185 00000100:00100000:0.0:1789265186.385580:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265186.385737:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397463168 00000100:00100000:2.0:1789265186.385747:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397463168 00000100:00100000:2.0:1789265186.385815:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 186 00000100:00100000:2.0:1789265186.385825:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10119dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1230cd-a81b-4bcc-a532-e24f5353fef4+10:6105:x1876180397463168:12345-192.168.203.37@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789265186.386295:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10119dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1230cd-a81b-4bcc-a532-e24f5353fef4+10:6105:x1876180397463168:12345-192.168.203.37@tcp:502:llog_process_th.0 Request processed in 469us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265186.386304:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 186 00000100:00100000:2.0:1789265186.403966:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265186.409472:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397463296 00000100:00100000:0.0:1789265186.409488:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397463296 00000100:00100000:0.0:1789265186.409551:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 187 00000100:00100000:0.0:1789265186.409562:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10119dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1230cd-a81b-4bcc-a532-e24f5353fef4+10:6105:x1876180397463296:12345-192.168.203.37@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789265186.410935:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10119dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1230cd-a81b-4bcc-a532-e24f5353fef4+10:6105:x1876180397463296:12345-192.168.203.37@tcp:502:llog_process_th.0 Request processed in 1367us (6971us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265186.410948:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 187 00010000:00010000:2.0:1789265187.126203:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265187.574043:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265187.574109:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265187.574133:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265187.574158:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265187.574325:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397463424 00000100:00100000:3.0:1789265187.574334:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397463424 00000100:00100000:3.0:1789265187.574382:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 188 00000100:00100000:3.0:1789265187.574390:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10119df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1230cd-a81b-4bcc-a532-e24f5353fef4+10:2351:x1876180397463424:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789265187.574448:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10119df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1230cd-a81b-4bcc-a532-e24f5353fef4+10:2351:x1876180397463424:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 59us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265187.574455:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 188 00000100:00100000:3.0:1789265187.574565:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397463808 00000100:00100000:3.0:1789265187.574570:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397463808 00000100:00100000:3.0:1789265187.574600:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397463680 00000100:00100000:3.0:1789265187.574602:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397463680 00000100:00100000:3.0:1789265187.574614:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 11 00000100:00100000:3.0:1789265187.574620:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10349cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+5:2351:x1876180397463808:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789265187.574645:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10349cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+5:2351:x1876180397463808:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 25us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265187.574651:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 11 00000100:00100000:3.0:1789265187.574661:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 12 00000100:00100000:3.0:1789265187.574665:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10349cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+5:2351:x1876180397463680:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789265187.574681:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10349cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+5:2351:x1876180397463680:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 16us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265187.574697:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 12 00000100:00080000:3.0:1789265187.574711:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789265187.574714:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789265187.583252:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397463552 00000100:00100000:1.0:1789265187.583267:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397463552 00000100:00080000:1.0:1789265187.583311:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265187.583368:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 23 00000100:00100000:1.0:1789265187.583378:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10349cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:2351:x1876180397463552:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789265187.583474:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10349cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:2351:x1876180397463552:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 97us (9438us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265187.583482:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 23 00000100:00100000:3.0:1789265187.638233:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1016d45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414268800:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789265187.638305:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265187.641839:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414268800 00000100:00100000:3.0:1789265187.641857:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414268800 00000100:00100000:3.0:1789265187.641934:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789265187.641945:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102e765880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414268800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789265187.641986:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789265187.642070:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102e765880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414268800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (3763us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265187.642098:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1789265187.642207:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1016d45f80 x1876180414268800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265203 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265187.642228:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1016d45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414268800:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789265187.642303:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789265188.146231:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265188.658662:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c079f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1876180414269184:0@lo:400:kworker.0 00000100:00100000:2.0:1789265188.658715:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c078380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:871daf34-1206-40e7-bd71-78303abe4d37:3317:1876180414268928:0@lo:400:kworker.0 00000100:00100000:1.0:1789265188.658732:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265188.658763:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265188.658810:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c07b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1876180414269440:0@lo:400:kworker.0 00000100:00100000:1.0:1789265188.658829:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789265188.658836:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265188.658840:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c078000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414269312:0@lo:400:kworker.0 00000100:00100000:3.0:1789265188.658892:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c079c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876180414269056:0@lo:400:kworker.0 00000100:00100000:1.0:1789265188.658893:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265188.658941:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414269312 00000100:00100000:3.0:1789265188.658943:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414268928 00000100:00100000:1.0:1789265188.658948:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414269312 00000100:00100000:3.0:1789265188.658950:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414268928 00000100:00100000:3.0:1789265188.658997:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1789265188.659003:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789265188.659008:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10119de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+19:3317:x1876180414268928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265188.659015:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1016d47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414269312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265188.659065:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10119de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+19:3317:x1876180414268928:12345-0@lo:400:kworker.0 Request processed in 59us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265188.659098:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1016d47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414269312:12345-0@lo:400:kworker.0 Request processed in 62us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265188.659110:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1789265188.659110:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1789265188.659159:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a103c078000 x1876180414269312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265204 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265188.659174:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c078000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414269312:0@lo:400:kworker.0 00000100:00100000:2.0:1789265188.664171:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c078380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:871daf34-1206-40e7-bd71-78303abe4d37:3317:1876180414268928:0@lo:400:kworker.0 00000100:00100000:1.0:1789265188.664261:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265188.664464:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414269184 00000100:00100000:0.0:1789265188.664472:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414269184 00000100:00100000:0.0:1789265188.664600:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414269440 00000100:00100000:0.0:1789265188.664605:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414269440 00000100:00080000:2.0:1789265188.664742:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265188.664774:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789265188.664786:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1016d44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876180414269184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265188.664866:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1016d44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876180414269184:12345-0@lo:400:kworker.0 Request processed in 82us (6135us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265188.664886:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789265188.664954:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c079f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1876180414269184:0@lo:400:kworker.0 00000100:00100000:0.0:1789265188.665156:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789265188.665163:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10349c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1876180414269440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265188.665205:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10349c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1876180414269440:12345-0@lo:400:kworker.0 Request processed in 43us (6370us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265188.665211:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789265188.665283:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c07b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1876180414269440:0@lo:400:kworker.0 00000100:00100000:1.0:1789265188.666838:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c079500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414269568:0@lo:400:kworker.0 00000100:00100000:1.0:1789265188.666912:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265188.667011:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414269056 00000100:00100000:3.0:1789265188.667020:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414269056 00000100:00100000:3.0:1789265188.667062:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789265188.667087:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1016d45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876180414269056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265188.667135:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1016d45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876180414269056:12345-0@lo:400:kworker.0 Request processed in 65us (2875us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265188.667142:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789265188.667483:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c079c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876180414269056:0@lo:400:kworker.0 00000100:00100000:0.0:1789265188.667713:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414269568 00000100:00100000:0.0:1789265188.667719:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414269568 00000100:00100000:0.0:1789265188.667804:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789265188.667813:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1016d45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1876180414269568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265188.667866:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1016d45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1876180414269568:12345-0@lo:400:kworker.0 Request processed in 55us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265188.667881:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1789265188.668110:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a103c079500 x1876180414269568/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265204 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265188.668122:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c079500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414269568:0@lo:400:kworker.0 00000100:00080000:2.0:1789265188.668172:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789265189.170283:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1016d47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414269696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789265189.170363:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789265189.170470:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265189.170526:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414269696 00000100:00100000:1.0:1789265189.170534:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414269696 00000100:00100000:1.0:1789265189.170593:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789265189.170603:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10349c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414269696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789265189.170639:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789265189.170689:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10349c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414269696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265189.170696:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1789265189.170733:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1016d47b80 x1876180414269696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265205 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265189.170752:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1016d47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414269696:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789265190.194204:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265191.218281:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789265191.765353:0:8794:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg337-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:2.0:1789265192.242292:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265192.692297:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265192.692345:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265192.692397:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265192.692481:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397464192 00000100:00100000:1.0:1789265192.692500:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397464192 00000100:00100000:1.0:1789265192.692600:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 15 00000100:00100000:1.0:1789265192.692615:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102e765180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+5:2349:x1876180397464192:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789265192.692628:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397463936 00000100:00100000:0.0:1789265192.692641:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397463936 00000100:00100000:0.0:1789265192.692702:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 190 00000100:00100000:0.0:1789265192.692716:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10119dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1230cd-a81b-4bcc-a532-e24f5353fef4+10:2349:x1876180397463936:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789265192.692803:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265192.692815:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10119dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1230cd-a81b-4bcc-a532-e24f5353fef4+10:2349:x1876180397463936:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 100us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265192.692818:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102e765180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+5:2349:x1876180397464192:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 202us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265192.692834:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 190 00000100:00100000:1.0:1789265192.692840:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 15 00000100:00100000:1.0:1789265192.692886:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397464320 00000100:00100000:1.0:1789265192.692891:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397464320 00000100:00100000:0.0:1789265192.692930:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397464064 00000100:00100000:1.0:1789265192.692937:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 16 00000100:00100000:0.0:1789265192.692938:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397464064 00000100:00100000:1.0:1789265192.692956:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102e765c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+5:2348:x1876180397464320:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789265192.693001:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 27 00000100:00100000:0.0:1789265192.693013:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102e767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:2348:x1876180397464064:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789265192.693024:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102e765c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+5:2348:x1876180397464320:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 70us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265192.693036:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 16 00000100:00100000:0.0:1789265192.693068:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102e767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:2348:x1876180397464064:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 56us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265192.693107:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 27 00000100:00080000:3.0:1789265192.693116:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789265192.693122:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789265192.693126:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265192.755713:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1016d47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414269824:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789265192.755811:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265192.756001:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414269824 00000100:00100000:1.0:1789265192.756011:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414269824 00000100:00100000:0.0:1789265192.756182:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789265192.756193:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c07b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414269824:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789265192.757683:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1789265192.763394:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00010000:00080000:1.0:1789265192.763621:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1016d47b80 x1876180414269824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265208 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265192.763655:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1016d47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414269824:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789265192.763750:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c07b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414269824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7554us (7933us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265192.763762:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1789265193.267448:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265193.778751:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c078e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:871daf34-1206-40e7-bd71-78303abe4d37:3317:1876180414269952:0@lo:400:kworker.0 00000100:00100000:2.0:1789265193.778833:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265193.778919:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c079f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1876180414270464:0@lo:400:kworker.0 00000100:00100000:2.0:1789265193.778947:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265193.778993:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789265193.778999:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c079180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876180414270080:0@lo:400:kworker.0 00000100:00100000:2.0:1789265193.779021:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265193.779043:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c078380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414270592:0@lo:400:kworker.0 00000100:00100000:2.0:1789265193.779114:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265193.779156:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414270464 00000100:00100000:2.0:1789265193.779163:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414270464 00000100:00100000:2.0:1789265193.779214:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414270080 00000100:00100000:2.0:1789265193.779217:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414270080 00000100:00100000:2.0:1789265193.779239:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789265193.779248:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10349caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1876180414270464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265193.779301:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10349caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1876180414270464:12345-0@lo:400:kworker.0 Request processed in 55us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265193.779308:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789265193.779336:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789265193.779341:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10349c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876180414270080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265193.779368:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10349c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876180414270080:12345-0@lo:400:kworker.0 Request processed in 26us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265193.779373:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789265193.779664:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414269952 00000100:00100000:0.0:1789265193.779669:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414269952 00000100:00100000:0.0:1789265193.779709:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1789265193.779718:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10119dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+19:3317:x1876180414269952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265193.779790:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414270592 00000100:00100000:3.0:1789265193.779794:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414270592 00000100:00100000:3.0:1789265193.779827:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789265193.779834:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10349c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1876180414270592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265193.779912:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c079500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1876180414270208:0@lo:400:kworker.0 00000100:00100000:2.0:1789265193.779993:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c079180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876180414270080:0@lo:400:kworker.0 00000100:00100000:0.0:1789265193.785341:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10119dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+19:3317:x1876180414269952:12345-0@lo:400:kworker.0 Request processed in 5615us (6498us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265193.785357:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1789265193.785464:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c079c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414270336:0@lo:400:kworker.0 00000100:00100000:0.0:1789265193.785506:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265193.785559:0:6685:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789265193.785568:0:6685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1789265193.785666:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414270336 00000100:00100000:0.0:1789265193.785674:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414270336 00000100:00100000:0.0:1789265193.785818:0:6685:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789265193.785828:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789265193.785837:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c078000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414270336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265193.785908:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c078000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414270336:12345-0@lo:400:kworker.0 Request processed in 72us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265193.785914:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1789265193.785948:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a103c079c00 x1876180414270336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265193.785980:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c079c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414270336:0@lo:400:kworker.0 00000100:00080000:0.0:1789265193.786062:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789265193.786067:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265193.790020:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10349c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1876180414270592:12345-0@lo:400:kworker.0 Request processed in 10176us (10895us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265193.790036:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789265193.793350:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265193.793584:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414270208 00000100:00100000:3.0:1789265193.793595:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414270208 00000100:00100000:3.0:1789265193.793667:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789265193.793678:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1016d47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876180414270208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265193.793746:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1016d47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876180414270208:12345-0@lo:400:kworker.0 Request processed in 70us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265193.793769:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1789265193.795673:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265193.795739:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c079500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1876180414270208:0@lo:400:kworker.0 00000100:00100000:2.0:1789265193.796096:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c079f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1876180414270464:0@lo:400:kworker.0 00010000:00080000:2.0:1789265193.796123:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a103c078380 x1876180414270592/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265193.796134:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c078380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414270592:0@lo:400:kworker.0 00000100:00100000:2.0:1789265193.796144:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c078e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:871daf34-1206-40e7-bd71-78303abe4d37:3317:1876180414269952:0@lo:400:kworker.0 00000100:00100000:0.0:1789265194.290748:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1016d47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414270720:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789265194.290821:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265194.290892:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414270720 00000100:00100000:3.0:1789265194.290900:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414270720 00000100:00100000:3.0:1789265194.290957:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789265194.290966:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c079c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414270720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789265194.291001:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789265194.299527:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c079c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414270720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 8553us (8697us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265194.299542:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:2.0:1789265194.301258:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:0.0:1789265194.301563:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1016d47100 x1876180414270720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265210 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265194.301587:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1016d47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414270720:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789265195.314400:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265196.338269:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789265197.119583:0:9039:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg337-server.virtnet: executing yml_node 00010000:00010000:3.0:1789265197.366367:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265197.808757:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265197.808852:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265197.809658:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265197.809729:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265197.810401:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397464704 00000100:00100000:2.0:1789265197.810412:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397464704 00000100:00100000:2.0:1789265197.810468:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397464832 00000100:00100000:2.0:1789265197.810472:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397464832 00000100:00100000:2.0:1789265197.810497:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 19 00000100:00100000:2.0:1789265197.810507:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102e765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+5:2349:x1876180397464704:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789265197.810600:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102e765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+5:2349:x1876180397464704:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 94us (1747us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265197.810607:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 19 00000100:00100000:2.0:1789265197.810625:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 20 00000100:00100000:2.0:1789265197.810631:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102e767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+5:2349:x1876180397464832:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789265197.810669:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102e767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+5:2349:x1876180397464832:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 38us (939us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265197.810676:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 20 00000100:00100000:0.0:1789265197.811230:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397464448 00000100:00100000:0.0:1789265197.811237:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397464448 00000100:00100000:0.0:1789265197.811272:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 192 00000100:00100000:0.0:1789265197.811280:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a100881c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+10:2349:x1876180397464448:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789265197.811318:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a100881c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+10:2349:x1876180397464448:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 38us (2585us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265197.811325:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 192 00000100:00100000:0.0:1789265197.811354:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397464576 00000100:00100000:0.0:1789265197.811358:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397464576 00000100:00100000:0.0:1789265197.811390:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 31 00000100:00100000:0.0:1789265197.811397:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102e764e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:2349:x1876180397464576:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789265197.811422:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102e764e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:2349:x1876180397464576:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 26us (1767us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265197.811440:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 31 00000100:00080000:3.0:1789265197.812727:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789265197.812743:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789265197.812746:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789265197.874988:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789265197.875009:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10349ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414270848:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789265197.875071:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265197.875579:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414270848 00000100:00100000:1.0:1789265197.875587:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414270848 00000100:00080000:3.0:1789265197.875810:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265197.875820:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789265197.875833:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10349c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414270848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789265197.875870:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789265197.875921:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10349c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414270848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265197.875928:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1789265197.875969:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a10349ca680 x1876180414270848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265213 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265197.875988:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10349ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414270848:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789265198.387296:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265198.898417:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10349ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:871daf34-1206-40e7-bd71-78303abe4d37:3317:1876180414270976:0@lo:400:kworker.0 00000100:00100000:0.0:1789265198.898491:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265198.898552:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10349c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1876180414271488:0@lo:400:kworker.0 00000100:00100000:0.0:1789265198.898577:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265198.898598:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789265198.898603:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10349c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876180414271104:0@lo:400:kworker.0 00000100:00100000:0.0:1789265198.898621:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265198.898637:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10349c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414271616:0@lo:400:kworker.0 00000100:00100000:0.0:1789265198.898655:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265198.898729:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414271488 00000100:00100000:0.0:1789265198.898736:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414271488 00000100:00100000:0.0:1789265198.898786:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414271104 00000100:00100000:0.0:1789265198.898789:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414271104 00000100:00100000:0.0:1789265198.898825:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789265198.898834:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c078e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1876180414271488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265198.898898:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c078e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1876180414271488:12345-0@lo:400:kworker.0 Request processed in 55us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265198.898906:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789265198.898923:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789265198.898929:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c078380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876180414271104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265198.898956:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c078380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876180414271104:12345-0@lo:400:kworker.0 Request processed in 27us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265198.898961:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789265198.898980:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414271616 00000100:00100000:0.0:1789265198.898997:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414271616 00000100:00100000:1.0:1789265198.899179:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10349c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1876180414271232:0@lo:400:kworker.0 00000100:00100000:1.0:1789265198.899210:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265198.899231:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789265198.899237:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10349c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414271360:0@lo:400:kworker.0 00000100:00100000:1.0:1789265198.899259:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265198.899306:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414270976 00000100:00100000:2.0:1789265198.899314:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414270976 00000100:00100000:2.0:1789265198.899343:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1789265198.899350:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a100881f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+19:3317:x1876180414270976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265198.899383:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a100881f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+19:3317:x1876180414270976:12345-0@lo:400:kworker.0 Request processed in 33us (891us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265198.899389:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1789265198.899433:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414271232 00000100:00100000:2.0:1789265198.899438:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414271232 00000100:00100000:2.0:1789265198.899458:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789265198.899464:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1016d46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876180414271232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265198.899493:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1016d46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876180414271232:12345-0@lo:400:kworker.0 Request processed in 30us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265198.899499:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1789265198.899518:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789265198.899522:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265198.899550:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10349c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876180414271104:0@lo:400:kworker.0 00000100:00100000:2.0:1789265198.899561:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10349ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:871daf34-1206-40e7-bd71-78303abe4d37:3317:1876180414270976:0@lo:400:kworker.0 00000100:00100000:2.0:1789265198.899569:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10349c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1876180414271488:0@lo:400:kworker.0 00000100:00100000:1.0:1789265198.900611:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10349c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1876180414271232:0@lo:400:kworker.0 00000100:00100000:0.0:1789265198.900705:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414271360 00000100:00100000:0.0:1789265198.900712:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414271360 00000100:00100000:0.0:1789265198.900760:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789265198.900769:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c079f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1876180414271616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265198.900846:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c079f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1876180414271616:12345-0@lo:400:kworker.0 Request processed in 77us (2188us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265198.900853:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789265198.900868:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789265198.900875:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1016d46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414271360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265198.901351:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1016d46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414271360:12345-0@lo:400:kworker.0 Request processed in 475us (2089us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265198.901359:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1789265198.901395:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a10349c8a80 x1876180414271616/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265198.901407:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10349c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414271616:0@lo:400:kworker.0 00010000:00080000:1.0:1789265198.901499:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a10349c8000 x1876180414271360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265198.901509:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10349c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414271360:0@lo:400:kworker.0 00000100:00100000:1.0:1789265199.410491:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789265199.410513:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1016d47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414271744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789265199.410575:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265199.410736:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414271744 00000100:00100000:2.0:1789265199.410745:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414271744 00000100:00100000:2.0:1789265199.410797:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789265199.410818:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1016d47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414271744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789265199.410855:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789265199.410912:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1016d47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414271744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265199.410919:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1789265199.411121:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1016d47480 x1876180414271744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265215 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265199.411141:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1016d47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414271744:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789265199.413179:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789265200.413072:0:9230:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.105 00010000:00010000:1.0:1789265200.436211:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265201.459102:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265202.482452:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789265202.608966:0:9328:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.105 00000100:00100000:3.0:1789265202.930289:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265202.930401:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265202.930495:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397464960 00000100:00100000:0.0:1789265202.930505:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397464960 00000100:00100000:0.0:1789265202.930564:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 194 00000100:00100000:0.0:1789265202.930574:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a100881d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1230cd-a81b-4bcc-a532-e24f5353fef4+10:2349:x1876180397464960:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789265202.930641:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a100881d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1230cd-a81b-4bcc-a532-e24f5353fef4+10:2349:x1876180397464960:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 68us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265202.930659:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 194 00000100:00100000:2.0:1789265202.930850:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397465088 00000100:00100000:2.0:1789265202.930855:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397465088 00000100:00100000:2.0:1789265202.931147:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 35 00000100:00100000:2.0:1789265202.931155:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102e767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:2349:x1876180397465088:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789265202.931193:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102e767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:2349:x1876180397465088:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 39us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265202.931209:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 35 00000100:00080000:3.0:1789265202.935136:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265202.938601:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265202.938657:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265202.939168:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397465216 00000100:00100000:0.0:1789265202.939179:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397465216 00000100:00080000:3.0:1789265202.939306:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265202.939394:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397465344 00000100:00100000:0.0:1789265202.939398:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397465344 00000100:00080000:3.0:1789265202.939455:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789265202.941365:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 10 00000100:00100000:2.0:1789265202.941390:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102e766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+5:2347:x1876180397465216:12345-192.168.203.37@tcp:9:kworker.0 00000020:00000080:2.0:1789265202.941436:0:8856:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x27274ba5bb951e63 00000100:00080000:2.0:1789265202.941449:0:8856:0:(import.c:65:import_set_state_nolock()) ffff8a103fac7800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789265202.941501:0:8856:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1789265202.941891:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102e766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+2:2347:x1876180397465216:12345-192.168.203.37@tcp:9:kworker.0 Request processed in 512us (3298us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265202.941900:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 10 00000100:00100000:2.0:1789265202.941923:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 11 00000100:00100000:2.0:1789265202.941931:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10088e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+5:2347:x1876180397465344:12345-192.168.203.37@tcp:9:kworker.0 00000020:00000080:2.0:1789265202.941959:0:8856:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x27274ba5bb951e6a 00000100:00080000:2.0:1789265202.941967:0:8856:0:(import.c:65:import_set_state_nolock()) ffff8a103fac5800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789265202.942000:0:8856:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:3.0:1789265202.942288:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265202.942354:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10088e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+2:2347:x1876180397465344:12345-192.168.203.37@tcp:9:kworker.0 Request processed in 424us (3707us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265202.942362:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 11 00010000:00010000:2.0:1789265202.942380:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265202.994163:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789265202.994182:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1016d45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414271872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789265202.994247:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265202.994313:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414271872 00000100:00100000:1.0:1789265202.994320:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414271872 00000100:00100000:1.0:1789265202.994367:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789265202.994376:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1016d44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414271872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789265202.994407:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789265202.994445:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1016d44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414271872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265202.994452:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1789265202.994470:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789265202.994496:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1016d45f80 x1876180414271872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265218 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265202.994514:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1016d45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414271872:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789265203.510141:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265204.020576:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10349ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876180414272128:0@lo:400:kworker.0 00000100:00100000:3.0:1789265204.020644:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265204.020702:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10349c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414272640:0@lo:400:kworker.0 00000100:00100000:3.0:1789265204.020727:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265204.020763:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789265204.020782:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10349c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:871daf34-1206-40e7-bd71-78303abe4d37:3318:1876180414272000:0@lo:400:kworker.0 00000100:00100000:3.0:1789265204.020809:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265204.020828:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10349c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1876180414272512:0@lo:400:kworker.0 00000100:00100000:3.0:1789265204.020849:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265204.020874:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10349cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414272384:0@lo:400:kworker.0 00000100:00100000:3.0:1789265204.020899:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265204.020916:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789265204.020921:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10349c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1876180414272256:0@lo:400:kworker.0 00000100:00100000:3.0:1789265204.020960:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265204.020989:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414272640 00000100:00100000:3.0:1789265204.020996:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414272640 00000100:00100000:3.0:1789265204.021043:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414272384 00000100:00100000:3.0:1789265204.021046:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414272384 00000100:00100000:3.0:1789265204.021068:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789265204.021104:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10088e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1876180414272640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265204.021154:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10088e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1876180414272640:12345-0@lo:400:kworker.0 Request processed in 78us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265204.021161:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789265204.021178:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789265204.021190:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10088e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414272384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265204.021234:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10088e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414272384:12345-0@lo:400:kworker.0 Request processed in 45us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265204.021240:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789265204.021258:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414272128 00000100:00100000:3.0:1789265204.021261:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414272128 00000100:00100000:3.0:1789265204.021279:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414272512 00000100:00100000:3.0:1789265204.021282:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414272512 00000100:00100000:3.0:1789265204.021293:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414272256 00000100:00100000:3.0:1789265204.021295:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414272256 00000100:00100000:3.0:1789265204.021306:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789265204.021312:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10088e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876180414272128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265204.021339:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10088e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876180414272128:12345-0@lo:400:kworker.0 Request processed in 28us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265204.021344:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789265204.021354:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789265204.021360:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10088e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1876180414272512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265204.021386:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10088e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1876180414272512:12345-0@lo:400:kworker.0 Request processed in 26us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265204.021391:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789265204.021401:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789265204.021407:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103fa64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1876180414272256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265204.021434:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103fa64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1876180414272256:12345-0@lo:400:kworker.0 Request processed in 28us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265204.021440:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789265204.021480:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10349c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1876180414272256:0@lo:400:kworker.0 00010000:00080000:3.0:1789265204.021504:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a10349cb800 x1876180414272384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265220 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265204.021514:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10349cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414272384:0@lo:400:kworker.0 00000100:00100000:3.0:1789265204.021544:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10349c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1876180414272512:0@lo:400:kworker.0 00000100:00100000:3.0:1789265204.021553:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10349ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876180414272128:0@lo:400:kworker.0 00010000:00080000:3.0:1789265204.021562:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a10349c8a80 x1876180414272640/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265220 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265204.021570:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10349c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414272640:0@lo:400:kworker.0 00000100:00080000:1.0:1789265204.021708:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789265204.021713:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789265204.021715:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789265204.021795:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414272000 00000100:00100000:2.0:1789265204.021799:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414272000 00000100:00100000:2.0:1789265204.021835:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1789265204.021842:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a100881dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+19:3318:x1876180414272000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265204.021888:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a100881dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+19:3318:x1876180414272000:12345-0@lo:400:kworker.0 Request processed in 47us (1078us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265204.021895:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1789265204.024371:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10349c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:871daf34-1206-40e7-bd71-78303abe4d37:3318:1876180414272000:0@lo:400:kworker.0 00010000:00010000:2.0:1789265204.530321:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265204.530511:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789265204.536270:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c079180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414272768:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789265204.536346:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265204.542827:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414272768 00000100:00100000:2.0:1789265204.542844:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414272768 00000100:00100000:2.0:1789265204.543953:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789265204.543969:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103fa66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414272768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789265204.544006:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789265204.544106:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103fa66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414272768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 142us (7758us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265204.544113:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1789265204.544195:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a103c079180 x1876180414272768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265220 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265204.544224:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c079180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414272768:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1789265205.233205:0:9425:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.105 00010000:00010000:0.0:1789265205.554283:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789265206.131785:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4b820fcb-1bab-4b78-bfa4-355c22a09cf8 00000020:00000080:0.0:1789265206.131793:0:6708:0:(genops.c:885:class_export_put()) final put ffff8a103fac7000/4b820fcb-1bab-4b78-bfa4-355c22a09cf8 00000020:00000080:1.0:1789265206.131858:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a103fac7000/4b820fcb-1bab-4b78-bfa4-355c22a09cf8 for lustre-OST0000 00000020:00000080:1.0:1789265206.131901:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a103fac7800 for lustre-OST0000 00010000:00010000:3.0:1789265206.590793:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789265207.038873:0:9475:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sat Sep 12 22:06:45 EDT 2026 00010000:00010000:0.0:1789265207.602647:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789265207.690350:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4b820fcb-1bab-4b78-bfa4-355c22a09cf8 00000020:00000080:2.0:1789265207.690359:0:7633:0:(genops.c:885:class_export_put()) final put ffff8a103fac3800/4b820fcb-1bab-4b78-bfa4-355c22a09cf8 00000020:00000080:0.0:1789265207.690465:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a103fac3800/4b820fcb-1bab-4b78-bfa4-355c22a09cf8 for lustre-OST0001 00000020:00000080:0.0:1789265207.690642:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a103fac5800 for lustre-OST0001 00000100:00100000:2.0:1789265208.055361:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265208.055405:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265208.055477:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397465600 00000100:00100000:0.0:1789265208.055487:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397465600 00000100:00100000:0.0:1789265208.055548:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 39 00000100:00100000:0.0:1789265208.055557:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10349c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:2349:x1876180397465600:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789265208.055619:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10349c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:2349:x1876180397465600:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 64us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265208.055627:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 39 00000100:00080000:2.0:1789265208.055670:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265208.070010:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397465472 00000100:00100000:3.0:1789265208.070025:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397465472 00000100:00100000:3.0:1789265208.070143:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 196 00000100:00100000:3.0:1789265208.070153:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a100881fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1230cd-a81b-4bcc-a532-e24f5353fef4+10:2349:x1876180397465472:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789265208.070234:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a100881fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1230cd-a81b-4bcc-a532-e24f5353fef4+10:2349:x1876180397465472:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 83us (14882us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265208.070242:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 196 00000100:00100000:1.0:1789265208.119944:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10349c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414272896:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789265208.120016:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265208.120152:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414272896 00000100:00100000:3.0:1789265208.120163:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414272896 00000100:00100000:3.0:1789265208.120223:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789265208.120244:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1016d45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414272896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789265208.120289:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1789265208.122343:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265208.133422:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1016d45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414272896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 13169us (13395us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265208.133439:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1789265208.139345:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a10349c9f80 x1876180414272896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265224 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265208.139373:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10349c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414272896:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789265208.630804:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265209.138371:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789265209.138393:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1016d44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1876180414273280:0@lo:400:kworker.0 00000100:00100000:1.0:1789265209.138467:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265209.138552:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1016d44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414273408:0@lo:400:kworker.0 00000100:00100000:1.0:1789265209.138579:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265209.138729:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1016d44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:871daf34-1206-40e7-bd71-78303abe4d37:3317:1876180414273024:0@lo:400:kworker.0 00000100:00100000:0.0:1789265209.138772:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265209.138808:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1016d47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1876180414273536:0@lo:400:kworker.0 00000100:00100000:0.0:1789265209.138832:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265209.138860:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789265209.138866:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1016d45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876180414273152:0@lo:400:kworker.0 00000100:00100000:0.0:1789265209.138888:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265209.138916:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10091e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414273664:0@lo:400:kworker.0 00000100:00100000:0.0:1789265209.138938:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265209.138969:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414273280 00000100:00100000:0.0:1789265209.138976:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414273280 00000100:00100000:0.0:1789265209.139023:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414273536 00000100:00100000:0.0:1789265209.139026:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414273536 00000100:00100000:0.0:1789265209.139039:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414273152 00000100:00100000:0.0:1789265209.139042:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414273152 00000100:00100000:0.0:1789265209.139054:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789265209.139062:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1016d45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1876180414273280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265209.139135:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1016d45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1876180414273280:12345-0@lo:400:kworker.0 Request processed in 73us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265209.139141:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789265209.139155:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789265209.139161:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c079500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1876180414273536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265209.139202:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c079500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1876180414273536:12345-0@lo:400:kworker.0 Request processed in 41us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265209.139208:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789265209.139217:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789265209.139223:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c079180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876180414273152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265209.139245:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c079180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876180414273152:12345-0@lo:400:kworker.0 Request processed in 23us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265209.139251:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789265209.139265:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414273408 00000100:00100000:0.0:1789265209.139268:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414273408 00000100:00100000:0.0:1789265209.139288:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414273664 00000100:00100000:0.0:1789265209.139291:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414273664 00000100:00100000:0.0:1789265209.139308:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789265209.139319:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1016d46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414273408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265209.139344:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1016d46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414273408:12345-0@lo:400:kworker.0 Request processed in 26us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265209.139349:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789265209.139360:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789265209.139364:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1876180414273664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265209.139385:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1876180414273664:12345-0@lo:400:kworker.0 Request processed in 20us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265209.139390:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1789265209.139423:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1016d44380 x1876180414273408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265225 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265209.139438:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1016d44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414273408:0@lo:400:kworker.0 00000100:00100000:0.0:1789265209.139449:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1016d44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1876180414273280:0@lo:400:kworker.0 00000100:00100000:0.0:1789265209.139482:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1016d45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876180414273152:0@lo:400:kworker.0 00010000:00080000:0.0:1789265209.139492:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a10091e9500 x1876180414273664/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265225 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265209.139500:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10091e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414273664:0@lo:400:kworker.0 00000100:00100000:0.0:1789265209.139508:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1016d47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1876180414273536:0@lo:400:kworker.0 00000100:00100000:1.0:1789265209.139643:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414273024 00000100:00100000:1.0:1789265209.139648:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414273024 00000100:00100000:1.0:1789265209.139684:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1789265209.139691:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a100881cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+19:3317:x1876180414273024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265209.139726:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a100881cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+19:3317:x1876180414273024:12345-0@lo:400:kworker.0 Request processed in 36us (954us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265209.139732:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1789265209.139821:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1016d44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:871daf34-1206-40e7-bd71-78303abe4d37:3317:1876180414273024:0@lo:400:kworker.0 00000100:00080000:2.0:1789265209.140956:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789265209.140964:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265209.650260:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789265209.650295:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414273792:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789265209.650370:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265209.650449:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414273792 00000100:00100000:0.0:1789265209.650457:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414273792 00000100:00100000:0.0:1789265209.650499:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789265209.650508:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414273792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789265209.650543:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789265209.650585:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414273792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265209.650592:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1789265209.650633:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a0f02da1880 x1876180414273792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265225 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265209.650651:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414273792:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789265209.651445:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265210.674339:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265211.700132:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265212.723475:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265213.174675:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265213.174737:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265213.174827:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397465856 00000100:00100000:0.0:1789265213.174838:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397465856 00000100:00100000:0.0:1789265213.174919:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 43 00000100:00100000:0.0:1789265213.174929:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10349c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:2348:x1876180397465856:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789265213.175024:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10349c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:2348:x1876180397465856:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 97us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265213.175031:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 43 00000100:00080000:2.0:1789265213.175206:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265213.175406:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397465728 00000100:00100000:3.0:1789265213.175411:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397465728 00000100:00100000:3.0:1789265213.175507:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 198 00000100:00100000:3.0:1789265213.175515:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a100881f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1230cd-a81b-4bcc-a532-e24f5353fef4+10:2348:x1876180397465728:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789265213.175890:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a100881f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1230cd-a81b-4bcc-a532-e24f5353fef4+10:2348:x1876180397465728:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 374us (1151us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265213.175897:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 198 00000100:00100000:0.0:1789265213.234579:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10349ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414273920:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789265213.234657:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265213.235534:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414273920 00000100:00100000:1.0:1789265213.235557:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414273920 00000100:00100000:1.0:1789265213.235650:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789265213.235661:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414273920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789265213.235698:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1789265213.235790:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265213.238031:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414273920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2365us (3367us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265213.238045:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1789265213.238741:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a10349ca680 x1876180414273920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265229 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265213.238766:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10349ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414273920:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789265213.746497:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265214.259217:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1016d44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1876180414274304:0@lo:400:kworker.0 00000100:00100000:0.0:1789265214.259347:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265214.259423:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789265214.259430:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1016d47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414274432:0@lo:400:kworker.0 00000100:00100000:0.0:1789265214.259465:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265214.259512:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414274304 00000100:00100000:0.0:1789265214.259521:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414274304 00000100:00100000:0.0:1789265214.259595:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789265214.259607:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1016d44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876180414274304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265214.259670:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1016d44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876180414274304:12345-0@lo:400:kworker.0 Request processed in 65us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265214.259679:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789265214.259685:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876180414274176:0@lo:400:kworker.0 00000100:00100000:0.0:1789265214.259720:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414274432 00000100:00100000:0.0:1789265214.259725:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414274432 00000100:00100000:3.0:1789265214.259743:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265214.259756:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789265214.259774:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1016d44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414274688:0@lo:400:kworker.0 00000100:00100000:3.0:1789265214.259801:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265214.259823:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789265214.259829:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:871daf34-1206-40e7-bd71-78303abe4d37:3318:1876180414274048:0@lo:400:kworker.0 00000100:00100000:3.0:1789265214.259861:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265214.259884:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1016d45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1876180414274560:0@lo:400:kworker.0 00000100:00100000:3.0:1789265214.259906:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265214.260246:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414274176 00000100:00100000:1.0:1789265214.260251:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414274176 00000100:00100000:1.0:1789265214.260288:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414274560 00000100:00100000:1.0:1789265214.260291:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414274560 00000100:00100000:1.0:1789265214.260309:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789265214.260316:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103fa65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876180414274176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265214.260363:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103fa65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876180414274176:12345-0@lo:400:kworker.0 Request processed in 48us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265214.260370:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789265214.260384:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789265214.260390:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103fa66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1876180414274560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265214.260416:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103fa66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1876180414274560:12345-0@lo:400:kworker.0 Request processed in 27us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265214.260422:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789265214.260461:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1016d45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1876180414274560:0@lo:400:kworker.0 00000100:00100000:1.0:1789265214.260473:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876180414274176:0@lo:400:kworker.0 00000100:00100000:0.0:1789265214.261533:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c0d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414274432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265214.261619:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c0d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414274432:12345-0@lo:400:kworker.0 Request processed in 1855us (2152us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265214.261629:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789265214.261665:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414274688 00000100:00100000:0.0:1789265214.261672:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414274688 00000100:00100000:0.0:1789265214.261725:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789265214.261734:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103fa64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1876180414274688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265214.261780:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103fa64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1876180414274688:12345-0@lo:400:kworker.0 Request processed in 48us (1977us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265214.261787:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1789265214.261816:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789265214.261822:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265214.261868:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414274048 00000100:00100000:0.0:1789265214.261873:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414274048 00000100:00100000:0.0:1789265214.261905:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1789265214.261914:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a100881e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+19:3318:x1876180414274048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265214.261962:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a100881e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+19:3318:x1876180414274048:12345-0@lo:400:kworker.0 Request processed in 40us (2091us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265214.261969:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00010000:00080000:0.0:1789265214.262027:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1016d47480 x1876180414274432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265230 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265214.262042:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1016d47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414274432:0@lo:400:kworker.0 00000100:00100000:0.0:1789265214.262061:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1016d44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1876180414274304:0@lo:400:kworker.0 00000100:00100000:1.0:1789265214.266746:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:871daf34-1206-40e7-bd71-78303abe4d37:3318:1876180414274048:0@lo:400:kworker.0 00010000:00080000:1.0:1789265214.266779:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1016d44e00 x1876180414274688/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265230 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265214.266805:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1016d44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414274688:0@lo:400:kworker.0 00010000:00010000:0.0:1789265214.770608:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265214.775386:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103fa64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414274816:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789265214.775490:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265214.775612:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414274816 00000100:00100000:2.0:1789265214.775624:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414274816 00000100:00100000:2.0:1789265214.775717:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789265214.775730:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c0d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414274816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789265214.775793:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789265214.784474:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c0d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414274816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 8734us (8972us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265214.784495:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1789265214.785835:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a103fa64700 x1876180414274816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265230 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265214.785869:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103fa64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414274816:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789265215.798047:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265216.823167:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265217.845824:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265218.297373:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265218.297422:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265218.297502:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397465984 00000100:00100000:3.0:1789265218.297524:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397465984 00000100:00100000:3.0:1789265218.297585:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 200 00000100:00100000:3.0:1789265218.297596:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a100881a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1230cd-a81b-4bcc-a532-e24f5353fef4+10:2348:x1876180397465984:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789265218.297665:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a100881a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1230cd-a81b-4bcc-a532-e24f5353fef4+10:2348:x1876180397465984:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 71us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265218.297682:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 200 00000100:00100000:1.0:1789265218.297767:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397466112 00000100:00100000:1.0:1789265218.297772:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397466112 00000100:00100000:1.0:1789265218.297824:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 47 00000100:00100000:1.0:1789265218.297842:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10349c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:2348:x1876180397466112:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789265218.297887:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10349c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:2348:x1876180397466112:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 47us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265218.297895:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 47 00000100:00080000:3.0:1789265218.298046:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265218.354424:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10349cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414274944:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789265218.354496:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265218.354658:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414274944 00000100:00100000:2.0:1789265218.354682:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414274944 00000100:00100000:2.0:1789265218.354747:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789265218.354757:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c0d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414274944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789265218.354794:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789265218.354856:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c0d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414274944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265218.354863:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1789265218.354918:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a10349cb800 x1876180414274944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265234 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265218.354953:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10349cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414274944:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789265218.355793:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789265218.868261:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265219.384553:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10091ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876180414275200:0@lo:400:kworker.0 00000100:00100000:1.0:1789265219.384630:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265219.384762:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414275200 00000100:00100000:2.0:1789265219.384771:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414275200 00000100:00100000:2.0:1789265219.384822:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789265219.384833:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10091eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876180414275200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265219.384918:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10091e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414275712:0@lo:400:kworker.0 00000100:00100000:3.0:1789265219.384984:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10091e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:871daf34-1206-40e7-bd71-78303abe4d37:3317:1876180414275072:0@lo:400:kworker.0 00000100:00100000:0.0:1789265219.385112:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10091e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1876180414275328:0@lo:400:kworker.0 00000100:00100000:2.0:1789265219.387771:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10091eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876180414275200:12345-0@lo:400:kworker.0 Request processed in 2931us (3132us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265219.387787:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789265219.387953:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265219.388036:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10091ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876180414275200:0@lo:400:kworker.0 00000100:00100000:1.0:1789265219.388071:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10091e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414275456:0@lo:400:kworker.0 00000100:00100000:1.0:1789265219.388145:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265219.388176:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414275712 00000100:00100000:1.0:1789265219.388182:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414275712 00000100:00100000:1.0:1789265219.388223:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414275456 00000100:00100000:1.0:1789265219.388226:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414275456 00000100:00100000:1.0:1789265219.388246:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789265219.388255:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10091e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1876180414275712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265219.388303:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10091e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1876180414275712:12345-0@lo:400:kworker.0 Request processed in 50us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265219.388310:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789265219.388404:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789265219.388411:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10091ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414275456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265219.388448:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10091ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414275456:12345-0@lo:400:kworker.0 Request processed in 38us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265219.388454:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1789265219.388471:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789265219.388747:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265219.388778:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10091e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1876180414275584:0@lo:400:kworker.0 00000100:00100000:3.0:1789265219.388804:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265219.388835:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414275072 00000100:00100000:3.0:1789265219.388839:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414275072 00000100:00100000:3.0:1789265219.388866:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1789265219.388872:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a100881b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+19:3317:x1876180414275072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265219.388907:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a100881b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+19:3317:x1876180414275072:12345-0@lo:400:kworker.0 Request processed in 35us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265219.388913:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1789265219.388937:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414275584 00000100:00100000:3.0:1789265219.388941:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414275584 00000100:00100000:3.0:1789265219.388970:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789265219.388976:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103fa64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1876180414275584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265219.389005:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103fa64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1876180414275584:12345-0@lo:400:kworker.0 Request processed in 29us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265219.389010:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789265219.389038:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10091e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:871daf34-1206-40e7-bd71-78303abe4d37:3317:1876180414275072:0@lo:400:kworker.0 00000100:00100000:3.0:1789265219.389060:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10091e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1876180414275584:0@lo:400:kworker.0 00000100:00080000:3.0:1789265219.389097:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789265219.389160:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a10091e8000 x1876180414275456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265235 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265219.389177:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10091e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414275456:0@lo:400:kworker.0 00010000:00080000:1.0:1789265219.389205:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a10091e8a80 x1876180414275712/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265235 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265219.389214:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10091e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414275712:0@lo:400:kworker.0 00000100:00100000:0.0:1789265219.392600:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265219.392734:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414275328 00000100:00100000:0.0:1789265219.392743:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414275328 00000100:00100000:0.0:1789265219.392798:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789265219.392807:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c0d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876180414275328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265219.392869:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c0d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876180414275328:12345-0@lo:400:kworker.0 Request processed in 64us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265219.392877:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:0.0:1789265219.392900:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265219.392933:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10091e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1876180414275328:0@lo:400:kworker.0 00010000:00010000:0.0:1789265219.890557:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265219.891259:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789265219.891281:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103fa65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414275840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789265219.891404:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265219.891471:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414275840 00000100:00100000:2.0:1789265219.891478:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414275840 00000100:00100000:2.0:1789265219.891528:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789265219.891537:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10349cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414275840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789265219.891574:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789265219.891627:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10349cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414275840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265219.891634:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1789265219.891675:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a103fa65f80 x1876180414275840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265235 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265219.891694:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103fa65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414275840:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789265220.914339:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265221.938269:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265222.962419:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265223.413037:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265223.413127:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265223.413163:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397466240 00000100:00100000:2.0:1789265223.413177:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397466240 00000100:00100000:2.0:1789265223.413247:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 202 00000100:00100000:2.0:1789265223.413259:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008818450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+10:2348:x1876180397466240:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789265223.413362:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008818450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+10:2348:x1876180397466240:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 105us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265223.413371:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 202 00000100:00100000:0.0:1789265223.413609:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397466368 00000100:00100000:0.0:1789265223.413615:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397466368 00000100:00100000:0.0:1789265223.413689:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 51 00000100:00100000:0.0:1789265223.413697:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10349c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:2348:x1876180397466368:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789265223.413741:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10349c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:2348:x1876180397466368:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 46us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265223.413751:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 51 00000100:00080000:2.0:1789265223.413825:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265223.474690:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10349ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414275968:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789265223.474789:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265223.477681:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414275968 00000100:00100000:0.0:1789265223.477705:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414275968 00000100:00100000:0.0:1789265223.477931:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789265223.477954:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103fa65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414275968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789265223.478008:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789265223.486688:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103fa65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414275968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 8732us (11884us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265223.486804:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1789265223.490867:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789265223.497570:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a10349ca680 x1876180414275968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265239 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265223.497611:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10349ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414275968:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789265223.986431:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789265224.002828:0:10108:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 22:07:02 (1789265222) === 00000100:00100000:2.0:1789265224.410423:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265224.411141:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397466496 00000100:00100000:3.0:1789265224.411158:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397466496 00000100:00100000:3.0:1789265224.411236:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 203 00000100:00100000:3.0:1789265224.411247:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a100881b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1230cd-a81b-4bcc-a532-e24f5353fef4+10:8105:x1876180397466496:12345-192.168.203.37@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789265224.411269:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265224.411292:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1042045200/0x27274ba5bb951f2e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x73b61075d99efd0a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265224.411328:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1042045200/0x27274ba5bb951f2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efd0a expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265224.411340:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1042045200/0x27274ba5bb951f2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efd0a expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265224.411372:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1042045200, rc 0) 00000100:00100000:3.0:1789265224.411467:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a100881b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1230cd-a81b-4bcc-a532-e24f5353fef4+11:8105:x1876180397466496:12345-192.168.203.37@tcp:101:mount.lustre.0 Request processed in 221us (1062us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265224.411474:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 203 00000100:00100000:2.0:1789265224.422752:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265224.423327:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397466624 00000100:00100000:3.0:1789265224.423342:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397466624 00000100:00100000:3.0:1789265224.423428:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 204 00000100:00100000:3.0:1789265224.423440:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008819450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1230cd-a81b-4bcc-a532-e24f5353fef4+11:8105:x1876180397466624:12345-192.168.203.37@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789265224.423828:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008819450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1230cd-a81b-4bcc-a532-e24f5353fef4+11:8105:x1876180397466624:12345-192.168.203.37@tcp:501:mount.lustre.0 Request processed in 387us (1091us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265224.423837:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 204 00000100:00100000:0.0:1789265224.427041:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265224.427510:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397466752 00000100:00100000:2.0:1789265224.427524:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397466752 00000100:00100000:2.0:1789265224.427598:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 205 00000100:00100000:2.0:1789265224.427610:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008819c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+11:8105:x1876180397466752:12345-192.168.203.37@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789265224.428282:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008819c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+11:8105:x1876180397466752:12345-192.168.203.37@tcp:503:mount.lustre.0 Request processed in 670us (1252us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265224.428294:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 205 00000100:00100000:2.0:1789265224.445852:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265224.446231:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397466880 00000100:00100000:0.0:1789265224.446246:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397466880 00000100:00100000:0.0:1789265224.446322:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 206 00000100:00100000:0.0:1789265224.446335:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a100881bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1230cd-a81b-4bcc-a532-e24f5353fef4+11:8109:x1876180397466880:12345-192.168.203.37@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789265224.446832:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a100881bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1230cd-a81b-4bcc-a532-e24f5353fef4+11:8109:x1876180397466880:12345-192.168.203.37@tcp:502:llog_process_th.0 Request processed in 497us (995us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265224.446844:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 206 00000100:00100000:0.0:1789265224.470060:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265224.470259:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397467008 00000100:00100000:3.0:1789265224.470272:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397467008 00000100:00100000:3.0:1789265224.470345:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 207 00000100:00100000:3.0:1789265224.470358:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008818c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1230cd-a81b-4bcc-a532-e24f5353fef4+11:8109:x1876180397467008:12345-192.168.203.37@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789265224.470743:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008818c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1230cd-a81b-4bcc-a532-e24f5353fef4+11:8109:x1876180397467008:12345-192.168.203.37@tcp:502:llog_process_th.0 Request processed in 386us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265224.470752:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 207 00000100:00100000:2.0:1789265224.478912:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265224.479049:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397467136 00000100:00100000:0.0:1789265224.479063:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397467136 00000100:00100000:0.0:1789265224.479174:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 208 00000100:00100000:0.0:1789265224.479188:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a100881b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1230cd-a81b-4bcc-a532-e24f5353fef4+11:8105:x1876180397467136:12345-192.168.203.37@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789265224.479210:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265224.479234:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1017263200/0x27274ba5bb951f35 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x73b61075d99efd34 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265224.479273:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1017263200/0x27274ba5bb951f35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efd34 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265224.479285:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1017263200/0x27274ba5bb951f35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efd34 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265224.479297:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1017263200, rc 0) 00000100:00100000:0.0:1789265224.479387:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a100881b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1230cd-a81b-4bcc-a532-e24f5353fef4+12:8105:x1876180397467136:12345-192.168.203.37@tcp:101:mount.lustre.0 Request processed in 203us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265224.479416:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 208 00000100:00100000:2.0:1789265224.486357:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265224.486510:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397467264 00000100:00100000:3.0:1789265224.486532:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397467264 00000100:00100000:3.0:1789265224.486611:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 209 00000100:00100000:3.0:1789265224.486624:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a100881a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1230cd-a81b-4bcc-a532-e24f5353fef4+12:8105:x1876180397467264:12345-192.168.203.37@tcp:256:mount.lustre.0 20000000:01000000:3.0:1789265224.486669:0:5835:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789265224.486701:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789265224.486712:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789265224.486715:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789265224.486718:0:5835:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1789265224.489786:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a100881a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1230cd-a81b-4bcc-a532-e24f5353fef4+12:8105:x1876180397467264:12345-192.168.203.37@tcp:256:mount.lustre.0 Request processed in 3146us (3424us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265224.489805:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 209 00000100:00100000:2.0:1789265224.493831:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265224.493952:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397467392 00000100:00100000:0.0:1789265224.493966:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397467392 00000100:00100000:0.0:1789265224.494044:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 210 00000100:00100000:0.0:1789265224.494055:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008819850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+12:8105:x1876180397467392:12345-192.168.203.37@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789265224.494477:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265224.494514:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1017263000/0x27274ba5bb951f3c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x73b61075d99efd3b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265224.494554:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1017263000/0x27274ba5bb951f3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efd3b expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265224.494567:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1017263000/0x27274ba5bb951f3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efd3b expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265224.494577:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1017263000, rc 0) 00000100:00100000:0.0:1789265224.494668:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008819850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+13:8105:x1876180397467392:12345-192.168.203.37@tcp:101:mount.lustre.0 Request processed in 614us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265224.494676:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 210 00000100:00100000:2.0:1789265224.497304:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265224.497407:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397467520 00000100:00100000:3.0:1789265224.497420:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397467520 00000100:00100000:3.0:1789265224.497495:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 211 00000100:00100000:3.0:1789265224.497517:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008818050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1230cd-a81b-4bcc-a532-e24f5353fef4+13:8105:x1876180397467520:12345-192.168.203.37@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789265224.497888:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008818050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1230cd-a81b-4bcc-a532-e24f5353fef4+13:8105:x1876180397467520:12345-192.168.203.37@tcp:501:mount.lustre.0 Request processed in 374us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265224.497898:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 211 00000100:00100000:1.0:1789265224.499204:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10091e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1876180414276352:0@lo:400:kworker.0 00000100:00100000:1.0:1789265224.499277:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265224.499343:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789265224.499349:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10091ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414276480:0@lo:400:kworker.0 00000100:00100000:1.0:1789265224.499380:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265224.499422:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414276480 00000100:00100000:1.0:1789265224.499429:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414276480 00000100:00100000:1.0:1789265224.499479:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789265224.499489:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10091eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414276480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265224.499672:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10091e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876180414276224:0@lo:400:kworker.0 00000100:00100000:2.0:1789265224.499708:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265224.499732:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10091ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414276736:0@lo:400:kworker.0 00000100:00100000:2.0:1789265224.499756:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265224.499778:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789265224.499783:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10091e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:871daf34-1206-40e7-bd71-78303abe4d37:3318:1876180414276096:0@lo:400:kworker.0 00000100:00100000:2.0:1789265224.499829:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265224.499852:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10091eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1876180414276608:0@lo:400:kworker.0 00000100:00100000:2.0:1789265224.499901:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265224.500037:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414276736 00000100:00100000:3.0:1789265224.500043:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414276736 00000100:00100000:3.0:1789265224.500112:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789265224.500120:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10349ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1876180414276736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265224.500180:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10349ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1876180414276736:12345-0@lo:400:kworker.0 Request processed in 60us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265224.500187:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1789265224.500380:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789265224.500424:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a10091ea300 x1876180414276736/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265240 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265224.500439:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10091ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414276736:0@lo:400:kworker.0 00000100:00100000:0.0:1789265224.500681:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414276352 00000100:00100000:0.0:1789265224.500687:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414276352 00000100:00100000:0.0:1789265224.500740:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414276224 00000100:00100000:0.0:1789265224.500744:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414276224 00000100:00100000:0.0:1789265224.500757:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414276608 00000100:00100000:0.0:1789265224.500759:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414276608 00000100:00100000:0.0:1789265224.500775:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789265224.500782:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10091ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876180414276352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265224.500844:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10091ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876180414276352:12345-0@lo:400:kworker.0 Request processed in 62us (1568us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265224.500864:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789265224.500881:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789265224.500887:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10349c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876180414276224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265224.500926:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10349c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876180414276224:12345-0@lo:400:kworker.0 Request processed in 40us (1218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265224.500933:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789265224.500944:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789265224.500950:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008757100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1876180414276608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265224.500977:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008757100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1876180414276608:12345-0@lo:400:kworker.0 Request processed in 28us (1076us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265224.500983:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789265224.501287:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10091eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414276480:12345-0@lo:400:kworker.0 Request processed in 1797us (1903us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265224.501296:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1789265224.501677:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a10091ebb80 x1876180414276480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265240 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265224.501692:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10091ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414276480:0@lo:400:kworker.0 00000100:00100000:0.0:1789265224.501707:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10091e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1876180414276352:0@lo:400:kworker.0 00000100:00100000:0.0:1789265224.501752:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10091eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1876180414276608:0@lo:400:kworker.0 00000100:00100000:0.0:1789265224.501765:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10091e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876180414276224:0@lo:400:kworker.0 00000100:00100000:0.0:1789265224.501793:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414276096 00000100:00100000:0.0:1789265224.501799:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414276096 00000100:00100000:0.0:1789265224.501833:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1789265224.501841:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a100881a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+19:3318:x1876180414276096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265224.501890:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a100881a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+19:3318:x1876180414276096:12345-0@lo:400:kworker.0 Request processed in 50us (2060us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265224.501907:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1789265224.501948:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10091e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:871daf34-1206-40e7-bd71-78303abe4d37:3318:1876180414276096:0@lo:400:kworker.0 00000100:00080000:2.0:1789265224.502955:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265224.503838:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265224.504316:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397467648 00000100:00100000:1.0:1789265224.504330:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397467648 00000100:00100000:1.0:1789265224.504399:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 213 00000100:00100000:1.0:1789265224.504411:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008818850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+13:8105:x1876180397467648:12345-192.168.203.37@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789265224.505660:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008818850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+13:8105:x1876180397467648:12345-192.168.203.37@tcp:503:mount.lustre.0 Request processed in 1239us (1818us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265224.505677:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 213 00000100:00100000:2.0:1789265224.513539:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265224.513760:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397467776 00000100:00100000:3.0:1789265224.513775:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397467776 00000100:00100000:3.0:1789265224.513852:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 214 00000100:00100000:3.0:1789265224.513865:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a100881ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1230cd-a81b-4bcc-a532-e24f5353fef4+13:8113:x1876180397467776:12345-192.168.203.37@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789265224.514412:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a100881ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1230cd-a81b-4bcc-a532-e24f5353fef4+13:8113:x1876180397467776:12345-192.168.203.37@tcp:502:llog_process_th.0 Request processed in 547us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265224.514433:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 214 00000100:00100000:3.0:1789265224.518478:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265224.518789:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397467904 00000100:00100000:1.0:1789265224.518802:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397467904 00000100:00100000:1.0:1789265224.518948:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 215 00000100:00100000:1.0:1789265224.518960:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008819050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+13:8113:x1876180397467904:12345-192.168.203.37@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789265224.519349:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008819050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+13:8113:x1876180397467904:12345-192.168.203.37@tcp:502:llog_process_th.0 Request processed in 388us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265224.519358:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 215 00000100:00100000:2.0:1789265224.533931:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265224.533985:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265224.534324:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397468032 00000100:00100000:3.0:1789265224.534339:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397468032 00000100:00100000:3.0:1789265224.534401:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397468416 00000100:00100000:3.0:1789265224.534405:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397468416 00000100:00100000:3.0:1789265224.534453:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 55 00000100:00100000:3.0:1789265224.534465:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008756d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:2349:x1876180397468416:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789265224.534581:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008756d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:2349:x1876180397468416:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 119us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265224.534590:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 55 00000100:00100000:3.0:1789265224.534615:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 10 00000100:00100000:3.0:1789265224.534621:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008756300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2347:x1876180397468032:12345-192.168.203.37@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789265224.534678:0:5841:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 477585d4-0dee-4ce9-beb5-a40b2f26e8a4@192.168.203.37@tcp t0 exp 0000000000000000 cur 270 last 0 00000020:00000080:3.0:1789265224.534725:0:5841:0:(genops.c:1385:class_connect()) connect: client 477585d4-0dee-4ce9-beb5-a40b2f26e8a4, cookie 0x27274ba5bb951f43 00000004:00100000:3.0:1789265224.534764:0:5841:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789265224.536484:0:5841:0:(import.c:65:import_set_state_nolock()) ffff8a0f01b65000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789265224.536929:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008756300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+6:2347:x1876180397468032:12345-192.168.203.37@tcp:38:mount.lustre.0 Request processed in 2298us (3005us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265224.536942:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 10 00000100:00100000:2.0:1789265224.546871:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265224.548321:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397468288 00000100:00100000:1.0:1789265224.548342:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397468288 00000100:00100000:1.0:1789265224.548590:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 11 00000100:00100000:1.0:1789265224.548608:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008757480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+6:8105:x1876180397468288:12345-192.168.203.37@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789265224.548676:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00080000:2.0:1789265224.551951:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265224.552562:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008757480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+6:8105:x1876180397468288:12345-192.168.203.37@tcp:41:mount.lustre.0 Request processed in 3949us (5697us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265224.558438:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265224.558864:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 11 00000100:00100000:1.0:1789265224.560138:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397468160 00000100:00100000:1.0:1789265224.560153:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397468160 00000100:00100000:1.0:1789265224.560210:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 12 00000100:00100000:1.0:1789265224.560220:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103fa64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+6:0:x1876180397468160:12345-192.168.203.37@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789265224.560263:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789265224.560721:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103fa64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+6:0:x1876180397468160:12345-192.168.203.37@tcp:41:mount.lustre.0 Request processed in 500us (2296us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265224.560731:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 12 00000100:00100000:3.0:1789265224.564804:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265224.564897:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397468544 00000100:00100000:0.0:1789265224.564912:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397468544 00000100:00100000:0.0:1789265224.564983:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 13 00000100:00100000:0.0:1789265224.565009:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103fa67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+6:8105:x1876180397468544:12345-192.168.203.37@tcp:40:mount.lustre.0 00000100:00100000:0.0:1789265224.570032:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103fa67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+6:8105:x1876180397468544:12345-192.168.203.37@tcp:40:mount.lustre.0 Request processed in 5000us (5217us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265224.570056:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 13 00000100:00100000:0.0:1789265224.576993:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265224.577132:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265224.577444:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397468672 00000100:00100000:3.0:1789265224.577458:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397468672 00000100:00100000:3.0:1789265224.577522:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397468800 00000100:00100000:3.0:1789265224.577534:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397468800 00000100:00100000:3.0:1789265224.577565:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 12 00000100:00100000:3.0:1789265224.577576:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c0d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2347:x1876180397468672:12345-192.168.203.37@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789265224.577617:0:6684:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 477585d4-0dee-4ce9-beb5-a40b2f26e8a4@192.168.203.37@tcp t0 exp 0000000000000000 cur 270 last 0 00000020:00000080:3.0:1789265224.577667:0:6684:0:(genops.c:1385:class_connect()) connect: client 477585d4-0dee-4ce9-beb5-a40b2f26e8a4, cookie 0x27274ba5bb951f4a 00002000:00100000:3.0:1789265224.577682:0:6684:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 477585d4-0dee-4ce9-beb5-a40b2f26e8a4/ffff8a0f01b64800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113969 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789265224.577697:0:6684:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789265224.577974:0:6684:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789265224.578014:0:6684:0:(import.c:65:import_set_state_nolock()) ffff8a0f01b65800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789265224.578142:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c0d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+6:2347:x1876180397468672:12345-192.168.203.37@tcp:8:mount.lustre.0 Request processed in 566us (1162us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265224.578151:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 12 00000100:00100000:3.0:1789265224.578171:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 13 00000100:00100000:3.0:1789265224.578176:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10037b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2347:x1876180397468800:12345-192.168.203.37@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789265224.578193:0:6684:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 477585d4-0dee-4ce9-beb5-a40b2f26e8a4@192.168.203.37@tcp t0 exp 0000000000000000 cur 270 last 0 00000020:00000080:3.0:1789265224.578620:0:6684:0:(genops.c:1385:class_connect()) connect: client 477585d4-0dee-4ce9-beb5-a40b2f26e8a4, cookie 0x27274ba5bb951f51 00002000:00100000:3.0:1789265224.578639:0:6684:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 477585d4-0dee-4ce9-beb5-a40b2f26e8a4/ffff8a0f01b67000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113969 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789265224.578662:0:6684:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789265224.578889:0:6684:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789265224.578914:0:6684:0:(import.c:65:import_set_state_nolock()) ffff8a0f01b62000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789265224.578956:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10037b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+6:2347:x1876180397468800:12345-192.168.203.37@tcp:8:mount.lustre.0 Request processed in 778us (1823us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265224.578964:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 13 00000100:00100000:3.0:1789265224.582587:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265224.582741:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397468928 00000100:00100000:0.0:1789265224.582755:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397468928 00000100:00100000:0.0:1789265224.582831:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 1 00000100:00100000:0.0:1789265224.582843:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103fa65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+6:8105:x1876180397468928:12345-192.168.203.37@tcp:33:mount.lustre.0 00000004:00200000:0.0:1789265224.582944:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1789265224.583060:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103fa65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+6:8105:x1876180397468928:12345-192.168.203.37@tcp:33:mount.lustre.0 Request processed in 218us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265224.583298:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 1 00000100:00100000:1.0:1789265225.010444:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789265225.010482:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103fa65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414276864:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789265225.010502:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265225.010611:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265225.010731:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414276864 00000100:00100000:3.0:1789265225.010742:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414276864 00000100:00100000:3.0:1789265225.010894:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789265225.010979:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10091e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414276864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789265225.011011:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789265225.011171:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10091e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414276864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 195us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265225.011179:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1789265225.011356:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a103fa65880 x1876180414276864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265241 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265225.011379:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103fa65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414276864:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789265226.034231:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789265226.624809:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 477585d4-0dee-4ce9-beb5-a40b2f26e8a4 00010000:00010000:3.0:1789265227.065171:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789265227.615364:0:5863:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 477585d4-0dee-4ce9-beb5-a40b2f26e8a4 00010000:00010000:2.0:1789265228.082156:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789265228.126697:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 477585d4-0dee-4ce9-beb5-a40b2f26e8a4 00000100:00100000:0.0:1789265228.597306:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789265228.597328:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1008755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414276992:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789265228.597412:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265228.597671:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414276992 00000100:00100000:3.0:1789265228.597679:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414276992 00000100:00100000:3.0:1789265228.597743:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789265228.597753:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10037b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414276992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789265228.597790:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789265228.597855:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10037b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414276992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265228.597862:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1789265228.598143:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789265228.598342:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1008755c00 x1876180414276992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265244 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265228.598363:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1008755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414276992:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789265229.106835:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265229.618335:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10091e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:871daf34-1206-40e7-bd71-78303abe4d37:3317:1876180414277120:0@lo:400:kworker.0 00000100:00100000:1.0:1789265229.618356:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10091e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1876180414277376:0@lo:400:kworker.0 00000100:00100000:2.0:1789265229.618452:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10091eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876180414277248:0@lo:400:kworker.0 00000100:00100000:1.0:1789265229.625943:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265229.630979:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789265229.631008:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10091e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414277504:0@lo:400:kworker.0 00000100:00100000:1.0:1789265229.631091:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265229.631175:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414277376 00000100:00100000:1.0:1789265229.631186:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414277376 00000100:00100000:1.0:1789265229.631264:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789265229.631275:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10091ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876180414277376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265229.631312:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265229.631435:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265229.631440:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10091eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1876180414277632:0@lo:400:kworker.0 00000100:00100000:2.0:1789265229.631470:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10091e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414277760:0@lo:400:kworker.0 00000100:00100000:2.0:1789265229.636618:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265229.636717:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265229.636776:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414277120 00000100:00100000:3.0:1789265229.636787:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414277120 00000100:00100000:3.0:1789265229.636848:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1789265229.636875:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414277504 00000100:00100000:2.0:1789265229.636881:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414277504 00000100:00100000:2.0:1789265229.636915:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414277760 00000100:00100000:2.0:1789265229.636918:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414277760 00000100:00100000:2.0:1789265229.636945:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789265229.636962:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10091ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414277504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265229.636986:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+19:3317:x1876180414277120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265229.637816:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+19:3317:x1876180414277120:12345-0@lo:400:kworker.0 Request processed in 830us (6909us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265229.637827:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1789265229.638317:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414277248 00000100:00100000:3.0:1789265229.638326:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414277248 00000100:00100000:3.0:1789265229.638433:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414277632 00000100:00100000:3.0:1789265229.638437:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414277632 00000100:00100000:3.0:1789265229.638463:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789265229.638544:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008754380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876180414277248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265229.638692:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008754380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876180414277248:12345-0@lo:400:kworker.0 Request processed in 152us (7257us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265229.638700:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789265229.638716:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789265229.638722:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103fa67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1876180414277632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265229.638751:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103fa67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1876180414277632:12345-0@lo:400:kworker.0 Request processed in 30us (2036us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265229.638758:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789265229.638789:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789265229.638799:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008756a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1876180414277760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265229.638830:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008756a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1876180414277760:12345-0@lo:400:kworker.0 Request processed in 34us (2236us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265229.638836:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789265229.639689:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10091eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876180414277248:0@lo:400:kworker.0 00010000:00080000:3.0:1789265229.639723:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a10091e9880 x1876180414277760/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265245 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265229.639763:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10091e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414277760:0@lo:400:kworker.0 00000100:00100000:3.0:1789265229.639827:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10091eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1876180414277632:0@lo:400:kworker.0 00000100:00100000:3.0:1789265229.639841:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10091e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:871daf34-1206-40e7-bd71-78303abe4d37:3317:1876180414277120:0@lo:400:kworker.0 00000100:00080000:0.0:1789265229.639899:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789265229.639908:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265229.640200:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10091ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414277504:12345-0@lo:400:kworker.0 Request processed in 3236us (9120us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265229.640212:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789265229.642329:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10091ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876180414277376:12345-0@lo:400:kworker.0 Request processed in 11040us (16384us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265229.642348:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:2.0:1789265229.649010:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a10091e8000 x1876180414277504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265245 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265229.649036:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10091e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414277504:0@lo:400:kworker.0 00000100:00100000:3.0:1789265229.650127:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10091e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1876180414277376:0@lo:400:kworker.0 00000100:00100000:0.0:1789265230.067227:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265230.067272:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265230.067302:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397469056 00000100:00100000:0.0:1789265230.067302:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265230.067316:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397469056 00000100:00100000:0.0:1789265230.067322:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265230.067347:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265230.067372:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397469312 00000100:00100000:0.0:1789265230.067376:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397469312 00000100:00100000:1.0:1789265230.067385:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 217 00000100:00100000:1.0:1789265230.067404:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+13:2348:x1876180397469056:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789265230.067431:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397469184 00000100:00100000:0.0:1789265230.067435:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397469184 00000100:00100000:0.0:1789265230.067457:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 59 00000100:00100000:0.0:1789265230.067464:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10037b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+5:2348:x1876180397469312:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789265230.067495:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10037b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+5:2348:x1876180397469312:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 32us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265230.067496:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+13:2348:x1876180397469056:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 93us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265230.067504:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 59 00000100:00100000:1.0:1789265230.067505:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 217 00000100:00100000:0.0:1789265230.067522:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 60 00000100:00100000:0.0:1789265230.067527:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10037b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:2348:x1876180397469184:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789265230.067551:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10037b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:2348:x1876180397469184:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 23us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265230.067556:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 60 00000100:00100000:0.0:1789265230.067576:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397469568 00000100:00100000:0.0:1789265230.067579:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397469568 00000100:00100000:0.0:1789265230.067620:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397469440 00000100:00100000:0.0:1789265230.067623:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397469440 00000100:00100000:0.0:1789265230.067647:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 35 00000100:00100000:0.0:1789265230.067654:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10037b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+5:2348:x1876180397469568:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789265230.067691:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10037b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+5:2348:x1876180397469568:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 37us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265230.067699:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 35 00000100:00100000:0.0:1789265230.067710:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 36 00000100:00100000:0.0:1789265230.067718:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10037b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+5:2348:x1876180397469440:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789265230.067741:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10037b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+5:2348:x1876180397469440:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 24us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265230.067748:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 36 00000100:00080000:0.0:1789265230.067772:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789265230.067776:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789265230.067779:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789265230.133069:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265230.143729:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789265230.143760:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10037b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414277888:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789265230.143858:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265230.143943:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414277888 00000100:00100000:0.0:1789265230.143953:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414277888 00000100:00100000:0.0:1789265230.144013:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789265230.144024:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10037b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414277888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789265230.144072:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789265230.144162:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10037b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414277888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 139us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265230.144170:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1789265230.144220:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a10037b0700 x1876180414277888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265246 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265230.144243:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10037b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414277888:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1789265230.163615:0:10305:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg337-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:3.0:1789265231.154389:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265232.179807:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265233.206069:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265233.714670:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789265233.714703:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1008755500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414278016:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789265233.714812:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265233.715065:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414278016 00000100:00100000:2.0:1789265233.715107:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414278016 00000100:00100000:2.0:1789265233.715184:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789265233.715197:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103fa67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414278016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789265233.715245:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789265233.715303:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103fa67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414278016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265233.715310:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1789265233.715362:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1008755500 x1876180414278016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265249 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265233.715384:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1008755500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414278016:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789265233.715675:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789265234.229136:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265234.739630:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10091e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:871daf34-1206-40e7-bd71-78303abe4d37:3317:1876180414278144:0@lo:400:kworker.0 00000100:00100000:0.0:1789265234.739726:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265234.739789:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10091e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1876180414278656:0@lo:400:kworker.0 00000100:00100000:0.0:1789265234.739817:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265234.739846:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789265234.739851:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10091e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876180414278272:0@lo:400:kworker.0 00000100:00100000:0.0:1789265234.739872:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265234.739886:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10091e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414278784:0@lo:400:kworker.0 00000100:00100000:0.0:1789265234.739908:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265234.739937:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10091e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414278528:0@lo:400:kworker.0 00000100:00100000:0.0:1789265234.739970:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265234.739989:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789265234.740066:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10091e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1876180414278400:0@lo:400:kworker.0 00000100:00100000:0.0:1789265234.740114:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265234.740146:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414278656 00000100:00100000:0.0:1789265234.740155:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414278656 00000100:00100000:1.0:1789265234.740204:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414278144 00000100:00100000:1.0:1789265234.740208:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414278144 00000100:00100000:0.0:1789265234.740220:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414278272 00000100:00100000:0.0:1789265234.740222:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414278272 00000100:00100000:0.0:1789265234.740234:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414278400 00000100:00100000:0.0:1789265234.740236:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414278400 00000100:00100000:1.0:1789265234.740240:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1789265234.740249:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789265234.740250:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+19:3317:x1876180414278144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265234.740255:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10037b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1876180414278656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265234.740378:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10037b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1876180414278656:12345-0@lo:400:kworker.0 Request processed in 122us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265234.740386:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789265234.740411:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789265234.740416:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10037b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876180414278272:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789265234.742283:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265234.750145:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+19:3317:x1876180414278144:12345-0@lo:400:kworker.0 Request processed in 9882us (10406us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265234.750165:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1789265234.750479:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10037b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876180414278272:12345-0@lo:400:kworker.0 Request processed in 10060us (10603us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265234.750489:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789265234.750520:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789265234.750538:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10037b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1876180414278400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265234.750636:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10037b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1876180414278400:12345-0@lo:400:kworker.0 Request processed in 106us (10523us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265234.750643:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789265234.750673:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414278784 00000100:00100000:0.0:1789265234.750682:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414278784 00000100:00100000:0.0:1789265234.750732:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414278528 00000100:00100000:0.0:1789265234.750736:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414278528 00000100:00100000:0.0:1789265234.750754:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789265234.750760:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10037b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1876180414278784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265234.750795:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10037b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1876180414278784:12345-0@lo:400:kworker.0 Request processed in 35us (10885us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265234.750801:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789265234.750812:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789265234.750817:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10037b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414278528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265234.750845:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10037b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414278528:12345-0@lo:400:kworker.0 Request processed in 28us (10874us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265234.750850:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789265234.751341:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10091e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1876180414278400:0@lo:400:kworker.0 00010000:00080000:0.0:1789265234.751360:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a10091e9500 x1876180414278528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265234.751382:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10091e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414278528:0@lo:400:kworker.0 00000100:00100000:0.0:1789265234.751432:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10091e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876180414278272:0@lo:400:kworker.0 00010000:00080000:0.0:1789265234.751446:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a10091e8000 x1876180414278784/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265234.751455:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10091e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414278784:0@lo:400:kworker.0 00000100:00100000:0.0:1789265234.751466:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10091e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:871daf34-1206-40e7-bd71-78303abe4d37:3317:1876180414278144:0@lo:400:kworker.0 00000100:00100000:0.0:1789265234.751478:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10091e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1876180414278656:0@lo:400:kworker.0 00000100:00080000:3.0:1789265234.751883:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789265235.185696:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265235.185745:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265235.185790:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265235.185820:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265235.185913:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265235.185960:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397469824 00000100:00100000:2.0:1789265235.185973:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397469824 00000100:00100000:2.0:1789265235.186065:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397469952 00000100:00100000:2.0:1789265235.186069:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397469952 00000100:00100000:2.0:1789265235.186125:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 64 00000100:00100000:2.0:1789265235.186137:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008755500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:2350:x1876180397469824:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789265235.186220:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008755500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:2350:x1876180397469824:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 86us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265235.186226:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 64 00000100:00100000:2.0:1789265235.186240:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 65 00000100:00100000:2.0:1789265235.186244:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008756680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+5:2350:x1876180397469952:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789265235.186258:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008756680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+5:2350:x1876180397469952:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 14us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265235.186262:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 65 00000100:00100000:2.0:1789265235.186274:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397470080 00000100:00100000:2.0:1789265235.186276:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397470080 00000100:00100000:2.0:1789265235.186304:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397470208 00000100:00100000:2.0:1789265235.186307:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397470208 00000100:00100000:2.0:1789265235.186329:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 39 00000100:00100000:2.0:1789265235.186335:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008754e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+5:2350:x1876180397470080:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789265235.186362:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008754e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+5:2350:x1876180397470080:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 27us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265235.186369:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 39 00000100:00100000:2.0:1789265235.186380:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 40 00000100:00100000:2.0:1789265235.186386:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008754700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+5:2350:x1876180397470208:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789265235.186409:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008754700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+5:2350:x1876180397470208:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 24us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265235.186426:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 40 00000100:00080000:2.0:1789265235.186443:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789265235.186449:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789265235.186452:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265235.187123:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397469696 00000100:00100000:1.0:1789265235.187131:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397469696 00000100:00100000:1.0:1789265235.187184:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 219 00000100:00100000:1.0:1789265235.187193:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1230cd-a81b-4bcc-a532-e24f5353fef4+13:2350:x1876180397469696:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789265235.187241:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1230cd-a81b-4bcc-a532-e24f5353fef4+13:2350:x1876180397469696:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 50us (1450us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265235.187248:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 219 00000100:00100000:1.0:1789265235.250349:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789265235.250389:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10037b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414278912:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789265235.250485:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265235.250872:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414278912 00000100:00100000:0.0:1789265235.250884:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414278912 00000100:00100000:0.0:1789265235.250962:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789265235.250974:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10091e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414278912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789265235.251031:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789265235.251125:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10091e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414278912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 153us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265235.251133:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1789265235.251279:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a10037b1880 x1876180414278912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265251 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265235.251303:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10037b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414278912:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789265235.258658:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265236.274437:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265237.303439:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265238.322531:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265238.835924:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1008754000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414279040:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789265238.835999:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265238.837222:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414279040 00000100:00100000:2.0:1789265238.837234:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414279040 00000100:00100000:2.0:1789265238.837310:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789265238.837331:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10037b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414279040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789265238.837368:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789265238.837447:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10037b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414279040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (1447us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265238.837453:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:2.0:1789265238.837495:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1008754000 x1876180414279040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265254 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265238.837512:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1008754000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414279040:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789265238.837729:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789265239.347135:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265239.864539:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10037b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1876180414279424:0@lo:400:kworker.0 00000100:00100000:2.0:1789265239.864630:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10037b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876180414279296:0@lo:400:kworker.0 00000100:00100000:2.0:1789265239.864690:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265239.864757:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1008e25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414279808:0@lo:400:kworker.0 00000100:00100000:2.0:1789265239.864786:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265239.864824:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789265239.864830:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10037b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:871daf34-1206-40e7-bd71-78303abe4d37:3318:1876180414279168:0@lo:400:kworker.0 00000100:00100000:2.0:1789265239.864860:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265239.864880:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10037b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1876180414279680:0@lo:400:kworker.0 00000100:00100000:2.0:1789265239.864903:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265239.864929:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10037b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414279552:0@lo:400:kworker.0 00000100:00100000:2.0:1789265239.864969:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265239.865003:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414279296 00000100:00100000:2.0:1789265239.865012:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414279296 00000100:00100000:2.0:1789265239.865118:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414279680 00000100:00100000:2.0:1789265239.865122:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414279680 00000100:00100000:2.0:1789265239.865163:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789265239.865173:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008754000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876180414279296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265239.865235:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008754000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876180414279296:12345-0@lo:400:kworker.0 Request processed in 63us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265239.865243:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789265239.865262:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789265239.865269:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008754a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1876180414279680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265239.865301:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008754a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1876180414279680:12345-0@lo:400:kworker.0 Request processed in 32us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265239.865306:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789265239.865326:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414279808 00000100:00100000:2.0:1789265239.865330:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414279808 00000100:00100000:2.0:1789265239.865358:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414279552 00000100:00100000:2.0:1789265239.865361:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414279552 00000100:00100000:2.0:1789265239.865379:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789265239.865386:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008755f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1876180414279808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265239.865418:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008755f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1876180414279808:12345-0@lo:400:kworker.0 Request processed in 32us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265239.865424:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789265239.865435:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789265239.865441:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1018b29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414279552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265239.865474:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1018b29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414279552:12345-0@lo:400:kworker.0 Request processed in 34us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265239.865489:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:2.0:1789265239.865693:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789265239.865699:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789265239.865742:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a10037b3480 x1876180414279552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265239.865758:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10037b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414279552:0@lo:400:kworker.0 00000100:00100000:2.0:1789265239.865792:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10037b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1876180414279680:0@lo:400:kworker.0 00000100:00100000:2.0:1789265239.865803:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10037b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876180414279296:0@lo:400:kworker.0 00010000:00080000:2.0:1789265239.865813:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1008e25c00 x1876180414279808/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265239.865821:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1008e25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414279808:0@lo:400:kworker.0 00000100:00100000:0.0:1789265239.867441:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265239.867550:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414279424 00000100:00100000:0.0:1789265239.867560:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414279424 00000100:00100000:0.0:1789265239.867627:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789265239.867638:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008e24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876180414279424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265239.867723:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008e24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876180414279424:12345-0@lo:400:kworker.0 Request processed in 87us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265239.867731:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:0.0:1789265239.867754:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265239.867791:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10037b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1876180414279424:0@lo:400:kworker.0 00000100:00100000:1.0:1789265239.868449:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414279168 00000100:00100000:1.0:1789265239.868458:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414279168 00000100:00100000:1.0:1789265239.868504:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1789265239.868513:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+19:3318:x1876180414279168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265239.868595:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+19:3318:x1876180414279168:12345-0@lo:400:kworker.0 Request processed in 84us (3734us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265239.868602:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1789265239.868661:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10037b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:871daf34-1206-40e7-bd71-78303abe4d37:3318:1876180414279168:0@lo:400:kworker.0 00000100:00100000:3.0:1789265240.304986:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265240.305111:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265240.305150:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265240.305534:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397470464 00000100:00100000:0.0:1789265240.305548:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397470464 00000100:00100000:0.0:1789265240.305627:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 69 00000100:00100000:0.0:1789265240.305641:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103fa66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:2348:x1876180397470464:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789265240.305742:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103fa66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:2348:x1876180397470464:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 104us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265240.305751:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 69 00000100:00080000:0.0:1789265240.305779:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265240.306586:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265240.307507:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397470720 00000100:00100000:2.0:1789265240.307521:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397470720 00000100:00100000:3.0:1789265240.307607:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265240.307611:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 43 00000100:00100000:2.0:1789265240.307624:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103fa66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+5:2348:x1876180397470720:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789265240.307649:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397470592 00000100:00100000:3.0:1789265240.307655:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397470592 00000100:00100000:3.0:1789265240.307702:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 70 00000100:00100000:2.0:1789265240.307705:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103fa66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+5:2348:x1876180397470720:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 83us (2593us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265240.307714:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 43 00000100:00100000:2.0:1789265240.307733:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397470848 00000100:00100000:2.0:1789265240.307737:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397470848 00000100:00100000:2.0:1789265240.307759:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 44 00000100:00100000:2.0:1789265240.307765:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103fa65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+5:2348:x1876180397470848:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789265240.307803:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103fa65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+5:2348:x1876180397470848:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 38us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265240.307816:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 44 00000100:00100000:2.0:1789265240.307843:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397470336 00000100:00100000:2.0:1789265240.307846:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397470336 00000100:00100000:2.0:1789265240.307870:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 221 00000100:00100000:2.0:1789265240.307876:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1230cd-a81b-4bcc-a532-e24f5353fef4+13:2348:x1876180397470336:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789265240.307900:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1230cd-a81b-4bcc-a532-e24f5353fef4+13:2348:x1876180397470336:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 25us (2750us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265240.307906:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 221 00000100:00080000:1.0:1789265240.308417:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789265240.308423:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789265240.308426:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265240.309711:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103fa67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+5:2348:x1876180397470592:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789265240.309808:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103fa67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+5:2348:x1876180397470592:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 120us (4633us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265240.309818:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 70 00000100:00100000:1.0:1789265240.370374:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789265240.370407:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10091eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414279936:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789265240.370499:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265240.371098:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414279936 00000100:00100000:0.0:1789265240.371109:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414279936 00000100:00100000:0.0:1789265240.371171:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789265240.371182:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10091e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414279936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789265240.371229:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789265240.371295:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10091e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414279936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265240.371304:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:3.0:1789265240.372509:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:0.0:1789265240.372649:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a10091eb100 x1876180414279936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265256 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265240.372679:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10091eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414279936:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789265241.394657:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265242.418253:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265243.445047:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265243.955793:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789265243.955821:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1008756a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414280064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789265243.955890:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265243.956141:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414280064 00000100:00100000:2.0:1789265243.956150:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414280064 00000100:00100000:2.0:1789265243.956207:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789265243.956216:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008e26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414280064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789265243.956253:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789265243.956301:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008e26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414280064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265243.956308:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1789265243.956391:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789265243.956424:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1008756a00 x1876180414280064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265259 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265243.956443:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1008756a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414280064:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789265244.466658:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265244.978335:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10091eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876180414280320:0@lo:400:kworker.0 00000100:00100000:1.0:1789265244.978439:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265244.978515:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10091ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414280832:0@lo:400:kworker.0 00000100:00100000:1.0:1789265244.978544:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265244.978580:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789265244.978586:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10091eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:871daf34-1206-40e7-bd71-78303abe4d37:3318:1876180414280192:0@lo:400:kworker.0 00000100:00100000:1.0:1789265244.978612:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265244.978631:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10091eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1876180414280704:0@lo:400:kworker.0 00000100:00100000:1.0:1789265244.978651:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265244.978678:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10091e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1876180414280448:0@lo:400:kworker.0 00000100:00100000:1.0:1789265244.978704:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265244.978738:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789265244.978744:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10091ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414280576:0@lo:400:kworker.0 00000100:00100000:1.0:1789265244.978768:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265244.978807:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414280320 00000100:00100000:1.0:1789265244.978816:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414280320 00000100:00100000:1.0:1789265244.978870:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414280704 00000100:00100000:1.0:1789265244.978873:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414280704 00000100:00100000:1.0:1789265244.978899:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414280448 00000100:00100000:1.0:1789265244.978902:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414280448 00000100:00100000:1.0:1789265244.978920:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789265244.979262:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10091e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876180414280320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265244.979341:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10091e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876180414280320:12345-0@lo:400:kworker.0 Request processed in 412us (902us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265244.979350:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789265244.979450:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10091eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876180414280320:0@lo:400:kworker.0 00000100:00100000:1.0:1789265244.979514:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789265244.979522:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10091e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1876180414280704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265244.979569:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10091e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1876180414280704:12345-0@lo:400:kworker.0 Request processed in 47us (916us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265244.979576:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789265244.979589:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789265244.979596:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10091e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876180414280448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265244.979631:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10091e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876180414280448:12345-0@lo:400:kworker.0 Request processed in 36us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265244.979637:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789265244.979659:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414280832 00000100:00100000:1.0:1789265244.979665:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414280832 00000100:00100000:1.0:1789265244.979698:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414280576 00000100:00100000:1.0:1789265244.979700:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414280576 00000100:00100000:1.0:1789265244.979734:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789265244.979739:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10091e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1876180414280832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265244.979768:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10091e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1876180414280832:12345-0@lo:400:kworker.0 Request processed in 30us (1223us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265244.979774:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789265244.979782:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789265244.979787:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10091e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414280576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265244.979811:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10091e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414280576:12345-0@lo:400:kworker.0 Request processed in 24us (1042us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265244.979816:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789265244.979833:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414280192 00000100:00100000:1.0:1789265244.979837:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414280192 00000100:00100000:1.0:1789265244.979862:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1789265244.979868:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+19:3318:x1876180414280192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265244.979897:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+19:3318:x1876180414280192:12345-0@lo:400:kworker.0 Request processed in 29us (1284us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265244.979903:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1789265244.980028:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10091eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:871daf34-1206-40e7-bd71-78303abe4d37:3318:1876180414280192:0@lo:400:kworker.0 00000100:00100000:0.0:1789265244.980041:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10091eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1876180414280704:0@lo:400:kworker.0 00010000:00080000:0.0:1789265244.980055:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a10091ea300 x1876180414280832/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265244.980066:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10091ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414280832:0@lo:400:kworker.0 00000100:00080000:1.0:1789265244.980244:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789265244.980249:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789265244.980286:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a10091ea680 x1876180414280576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265244.980298:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10091ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414280576:0@lo:400:kworker.0 00000100:00100000:1.0:1789265244.980311:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10091e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1876180414280448:0@lo:400:kworker.0 00000100:00100000:0.0:1789265245.429889:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265245.429938:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265245.429974:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265245.430130:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397471360 00000100:00100000:1.0:1789265245.430142:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397471360 00000100:00100000:1.0:1789265245.430219:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 14 00000100:00100000:1.0:1789265245.430260:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008e25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+5:2347:x1876180397471360:12345-192.168.203.37@tcp:9:kworker.0 00000020:00000080:1.0:1789265245.430303:0:6682:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x27274ba5bb951f4a 00000100:00080000:1.0:1789265245.430314:0:6682:0:(import.c:65:import_set_state_nolock()) ffff8a0f01b65800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789265245.430372:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1789265245.430604:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265245.430939:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008e25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+2:2347:x1876180397471360:12345-192.168.203.37@tcp:9:kworker.0 Request processed in 680us (997us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265245.430949:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 14 00000100:00080000:1.0:1789265245.430978:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265245.431144:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397470976 00000100:00100000:3.0:1789265245.431152:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397470976 00000100:00100000:3.0:1789265245.431195:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 223 00000100:00100000:3.0:1789265245.431204:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+13:2350:x1876180397470976:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789265245.431238:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+13:2350:x1876180397470976:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 36us (1365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265245.431246:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 223 00010000:00010000:3.0:1789265245.431277:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265245.432460:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397471232 00000100:00100000:2.0:1789265245.432474:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397471232 00000100:00080000:3.0:1789265245.432607:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265245.432609:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265245.432806:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397471488 00000100:00100000:0.0:1789265245.432811:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397471488 00000100:00100000:0.0:1789265245.432860:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 15 00000100:00100000:0.0:1789265245.432870:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008e24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+5:2347:x1876180397471488:12345-192.168.203.37@tcp:9:kworker.0 00000020:00000080:0.0:1789265245.432902:0:8856:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x27274ba5bb951f51 00000100:00080000:0.0:1789265245.432913:0:8856:0:(import.c:65:import_set_state_nolock()) ffff8a0f01b62000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789265245.432961:0:8856:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:3.0:1789265245.433013:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789265245.433022:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789265245.434029:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008e24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+2:2347:x1876180397471488:12345-192.168.203.37@tcp:9:kworker.0 Request processed in 1156us (1419us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265245.434043:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 15 00000100:00100000:1.0:1789265245.434995:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397471104 00000100:00100000:1.0:1789265245.435009:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397471104 00000100:00080000:3.0:1789265245.435133:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265245.435152:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 74 00000100:00100000:1.0:1789265245.435165:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008e24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+5:2350:x1876180397471232:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789265245.435251:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008e24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+5:2350:x1876180397471232:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 89us (5276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265245.435260:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 74 00000100:00100000:1.0:1789265245.435283:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 75 00000100:00100000:1.0:1789265245.435289:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008e26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:2350:x1876180397471104:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789265245.435315:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008e26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:2350:x1876180397471104:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 26us (4712us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265245.435321:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 75 00010000:00010000:1.0:1789265245.490332:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265245.495334:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10091e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414280960:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789265245.495428:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265245.495596:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414280960 00000100:00100000:3.0:1789265245.495606:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414280960 00000100:00100000:3.0:1789265245.495678:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789265245.495690:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008754e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414280960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789265245.495736:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789265245.496755:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008754e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414280960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1051us (1311us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265245.496776:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1789265245.496997:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a10091e9180 x1876180414280960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265261 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265245.497025:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10091e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414280960:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789265246.515341:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789265247.085475:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 477585d4-0dee-4ce9-beb5-a40b2f26e8a4 00000020:00000080:3.0:1789265247.085499:0:6708:0:(genops.c:885:class_export_put()) final put ffff8a0f01b64800/477585d4-0dee-4ce9-beb5-a40b2f26e8a4 00000020:00000080:1.0:1789265247.085546:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a0f01b64800/477585d4-0dee-4ce9-beb5-a40b2f26e8a4 for lustre-OST0000 00000020:00000080:1.0:1789265247.085616:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a0f01b65800 for lustre-OST0000 00000001:02000400:0.0:1789265247.258042:0:11006:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1789265247.538564:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265248.567326:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789265248.636428:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 477585d4-0dee-4ce9-beb5-a40b2f26e8a4 00000020:00000080:2.0:1789265248.636449:0:7633:0:(genops.c:885:class_export_put()) final put ffff8a0f01b67000/477585d4-0dee-4ce9-beb5-a40b2f26e8a4 00000020:00000080:3.0:1789265248.636580:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a0f01b67000/477585d4-0dee-4ce9-beb5-a40b2f26e8a4 for lustre-OST0001 00000020:00000080:3.0:1789265248.636638:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a0f01b62000 for lustre-OST0001 00000100:00100000:1.0:1789265249.074396:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1008754700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414281088:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789265249.074511:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265249.074680:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414281088 00000100:00100000:0.0:1789265249.074690:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414281088 00000100:00100000:0.0:1789265249.074759:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789265249.074770:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10091ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414281088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789265249.074805:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789265249.074848:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10091ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414281088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265249.074856:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1789265249.075028:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789265249.075058:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1008754700 x1876180414281088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265265 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265249.075100:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1008754700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414281088:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789265249.587217:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265250.098583:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10091e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:871daf34-1206-40e7-bd71-78303abe4d37:3317:1876180414281216:0@lo:400:kworker.0 00000100:00100000:2.0:1789265250.098657:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265250.098800:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414281216 00000100:00100000:3.0:1789265250.098807:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414281216 00000100:00100000:3.0:1789265250.098854:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1789265250.098863:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+19:3317:x1876180414281216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265250.101239:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10091e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876180414281344:0@lo:400:kworker.0 00000100:00100000:0.0:1789265250.101308:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265250.103069:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414281344 00000100:00100000:1.0:1789265250.103103:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414281344 00000100:00100000:1.0:1789265250.103161:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789265250.103171:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008e24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876180414281344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265250.103254:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008e24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876180414281344:12345-0@lo:400:kworker.0 Request processed in 85us (1946us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265250.103261:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789265250.103306:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10091e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876180414281344:0@lo:400:kworker.0 00000100:00100000:1.0:1789265250.103382:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10091e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1876180414281472:0@lo:400:kworker.0 00000100:00100000:1.0:1789265250.103415:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265250.103471:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10091eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414281600:0@lo:400:kworker.0 00000100:00100000:1.0:1789265250.103496:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265250.103524:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414281600 00000100:00100000:1.0:1789265250.103527:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414281600 00000100:00100000:1.0:1789265250.103550:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789265250.103556:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10091eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414281600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265250.103671:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414281472 00000100:00100000:0.0:1789265250.103675:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414281472 00000100:00100000:0.0:1789265250.103705:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789265250.103711:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10091ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876180414281472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265250.104498:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10091ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876180414281472:12345-0@lo:400:kworker.0 Request processed in 782us (1077us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265250.104507:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789265250.105958:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10091eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414281600:12345-0@lo:400:kworker.0 Request processed in 2396us (2455us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265250.105972:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:1.0:1789265250.106023:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265250.106064:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10091e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1876180414281472:0@lo:400:kworker.0 00000100:00100000:2.0:1789265250.106174:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10091e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:871daf34-1206-40e7-bd71-78303abe4d37:3317:1876180414281216:0@lo:400:kworker.0 00010000:00080000:0.0:1789265250.106183:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a10091eb480 x1876180414281600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265250.106196:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10091eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414281600:0@lo:400:kworker.0 00000100:00100000:3.0:1789265250.106213:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+19:3317:x1876180414281216:12345-0@lo:400:kworker.0 Request processed in 7296us (7500us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265250.106283:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1789265250.106343:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10091e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1876180414281728:0@lo:400:kworker.0 00000100:00100000:0.0:1789265250.106507:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265250.107325:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414281728 00000100:00100000:2.0:1789265250.107334:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414281728 00000100:00100000:2.0:1789265250.107642:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789265250.107653:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008e25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1876180414281728:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789265250.108006:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265250.113961:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008e25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1876180414281728:12345-0@lo:400:kworker.0 Request processed in 6299us (7442us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265250.113976:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789265250.114266:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10091e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1876180414281728:0@lo:400:kworker.0 00000100:00100000:0.0:1789265250.114289:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789265250.114360:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10091eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414281856:0@lo:400:kworker.0 00000100:00100000:2.0:1789265250.114422:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265250.114560:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414281856 00000100:00100000:0.0:1789265250.114567:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414281856 00000100:00100000:0.0:1789265250.114623:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789265250.114633:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008755f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1876180414281856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265250.114682:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008755f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1876180414281856:12345-0@lo:400:kworker.0 Request processed in 51us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265250.114688:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:3.0:1789265250.114729:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789265250.114849:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a10091eb100 x1876180414281856/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265250.114860:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10091eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414281856:0@lo:400:kworker.0 00000100:00100000:1.0:1789265250.547386:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265250.547423:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265250.547476:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265250.547505:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397471744 00000100:00100000:1.0:1789265250.547514:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397471744 00000100:00100000:1.0:1789265250.547575:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397471872 00000100:00100000:1.0:1789265250.547578:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397471872 00000100:00100000:1.0:1789265250.547602:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 79 00000100:00100000:1.0:1789265250.547612:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10091eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:2349:x1876180397471744:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789265250.547682:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10091eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:2349:x1876180397471744:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 72us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265250.547690:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 79 00000100:00100000:1.0:1789265250.547707:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 80 00000100:00100000:1.0:1789265250.547713:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10091e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+5:2349:x1876180397471872:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789265250.547737:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10091e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+5:2349:x1876180397471872:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 24us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265250.547742:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 80 00000100:00080000:1.0:1789265250.547758:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265250.548195:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397471616 00000100:00100000:3.0:1789265250.548200:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397471616 00000100:00100000:3.0:1789265250.548228:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 225 00000100:00100000:3.0:1789265250.548234:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1230cd-a81b-4bcc-a532-e24f5353fef4+13:2349:x1876180397471616:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789265250.548276:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1230cd-a81b-4bcc-a532-e24f5353fef4+13:2349:x1876180397471616:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 42us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265250.548282:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 225 00000020:00000080:2.0:1789265250.588868:0:11154:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcf4634d80 20000000:00000080:2.0:1789265250.589204:0:11154:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8a103fb68c00 uarg=0000000000000000 20000000:01000000:2.0:1789265250.589336:0:11154:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789265250.589342:0:11154:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789265250.589347:0:11154:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1789265250.589995:0:11155:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1789265250.590222:0:11154:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789265250.595396:0:11154:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789265250.595430:0:11154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a103fad6c00/0x27274ba5bb951f58 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265250.595472:0:11154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a101b596e00/0x27274ba5bb951ebe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb951eb7 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265250.595479:0:11154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1017262400/0x27274ba5bb951ee8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb951ee1 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265250.595485:0:11154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a103fad6600/0x27274ba5bb951f12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb951f0b expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265250.595494:0:11154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1017262e00/0x27274ba5bb951f27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efd03 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265250.595501:0:11154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1017263000/0x27274ba5bb951f3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efd3b expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265250.595508:0:11154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a103fad6c00/0x27274ba5bb951f58 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265250.595555:0:11154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1017263000/0x27274ba5bb951f3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efd3b expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265250.595573:0:11154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a1017263000/0x27274ba5bb951f3c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efd3b expref: 12 pid: 5834 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265250.595589:0:11154:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1008757800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11154:1876180414281984:192.168.203.37@tcp:104: 00010000:00010000:2.0:1789265250.595796:0:11154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1017262e00/0x27274ba5bb951f27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efd03 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265250.595805:0:11154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a1017262e00/0x27274ba5bb951f27 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efd03 expref: 12 pid: 5833 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265250.595819:0:11154:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1008755180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11154:1876180414282112:192.168.203.37@tcp:104: 00010000:00010000:2.0:1789265250.595851:0:11154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a103fad6600/0x27274ba5bb951f12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27274ba5bb951f0b expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265250.595860:0:11154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a103fad6600/0x27274ba5bb951f12 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27274ba5bb951f0b expref: 18 pid: 5834 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265250.595870:0:11154:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1008755880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11154:1876180414282240:0@lo:104: 00000100:00100000:2.0:1789265250.595920:0:11154:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789265250.595963:0:11154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1017262400/0x27274ba5bb951ee8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27274ba5bb951ee1 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265250.595972:0:11154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a1017262400/0x27274ba5bb951ee8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27274ba5bb951ee1 expref: 18 pid: 5835 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265250.595980:0:11154:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1008754700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11154:1876180414282368:0@lo:104: 00000100:00100000:2.0:1789265250.596000:0:11154:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789265250.596019:0:11154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a101b596e00/0x27274ba5bb951ebe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27274ba5bb951eb7 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265250.596026:0:11154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a101b596e00/0x27274ba5bb951ebe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27274ba5bb951eb7 expref: 18 pid: 5835 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265250.596034:0:11154:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1008755c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11154:1876180414282496:0@lo:104: 00000100:00100000:2.0:1789265250.596051:0:11154:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265250.596060:0:11154:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1002d10c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789265250.596324:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414282240 00000100:00100000:0.0:1789265250.596332:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414282240 00000100:00100000:3.0:1789265250.597527:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414282368 00000100:00100000:3.0:1789265250.597536:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414282368 00000100:00100000:0.0:1789265250.597622:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414282496 00000100:00100000:0.0:1789265250.597626:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414282496 00000100:00100000:3.0:1789265250.597689:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789265250.597699:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008757b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:871daf34-1206-40e7-bd71-78303abe4d37+5:11154:x1876180414282240:12345-0@lo:104: 00010000:00010000:3.0:1789265250.597729:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff8a101b596600/0x27274ba5bb951f0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x27274ba5bb951f12 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265250.597855:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789265250.597862:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008757b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:871daf34-1206-40e7-bd71-78303abe4d37+5:11154:x1876180414282240:12345-0@lo:104: Request processed in 165us (1942us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265250.597869:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789265250.597896:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789265250.597903:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008756a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:871daf34-1206-40e7-bd71-78303abe4d37+4:11154:x1876180414282368:12345-0@lo:104: 00010000:00010000:3.0:1789265250.597910:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff8a103fad6200/0x27274ba5bb951ee1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x27274ba5bb951ee8 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265250.597940:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789265250.597946:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008756a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:871daf34-1206-40e7-bd71-78303abe4d37+4:11154:x1876180414282368:12345-0@lo:104: Request processed in 44us (1944us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265250.597950:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1789265250.598008:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789265250.598015:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff8a101b596600/0x27274ba5bb951f0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x27274ba5bb951f12 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265250.598022:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b596600 already unused, calling callback (ffffffffc1ba2c20) 10000000:00010000:1.0:1789265250.598026:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff8a101b596600/0x27274ba5bb951f0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x27274ba5bb951f12 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265250.598045:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff8a101b596600/0x27274ba5bb951f0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x27274ba5bb951f12 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265250.598051:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff8a101b596600/0x27274ba5bb951f0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x27274ba5bb951f12 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265250.598057:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789265250.598116:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff8a101b596600/0x27274ba5bb951f0b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951f12 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265250.598122:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789265250.598140:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff8a101b596600/0x27274ba5bb951f0b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951f12 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265250.598146:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff8a101b596600/0x27274ba5bb951f0b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951f12 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265250.598159:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265250.598162:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff8a103fad6200/0x27274ba5bb951ee1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x27274ba5bb951ee8 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265250.598166:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad6200 already unused, calling callback (ffffffffc1ba2c20) 10000000:00010000:1.0:1789265250.598169:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff8a103fad6200/0x27274ba5bb951ee1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x27274ba5bb951ee8 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265250.598175:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff8a103fad6200/0x27274ba5bb951ee1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x27274ba5bb951ee8 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265250.598181:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff8a103fad6200/0x27274ba5bb951ee1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x27274ba5bb951ee8 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265250.598192:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789265250.598206:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff8a103fad6200/0x27274ba5bb951ee1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951ee8 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265250.598211:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789265250.598217:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff8a103fad6200/0x27274ba5bb951ee1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951ee8 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265250.598224:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff8a103fad6200/0x27274ba5bb951ee1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951ee8 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265250.598233:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265250.598235:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265250.598237:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265250.598243:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265250.598256:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10091eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:871daf34-1206-40e7-bd71-78303abe4d37:3315:1876180414282624:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789265250.598296:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265250.598347:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789265250.598354:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10091e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:871daf34-1206-40e7-bd71-78303abe4d37:3315:1876180414282752:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789265250.598377:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265250.598404:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414282624 00000100:00100000:1.0:1789265250.598408:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414282624 00010000:00010000:1.0:1789265250.598425:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a103fad6600/0x27274ba5bb951f12 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27274ba5bb951f0b expref: 19 pid: 5834 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265250.598443:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414282752 00000100:00100000:1.0:1789265250.598446:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414282752 00010000:00010000:1.0:1789265250.598470:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1017262400/0x27274ba5bb951ee8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27274ba5bb951ee1 expref: 20 pid: 5835 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265250.598502:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789265250.598509:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10118e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:871daf34-1206-40e7-bd71-78303abe4d37+20:3315:x1876180414282624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789265250.598520:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265250.598525:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a103fad6600/0x27274ba5bb951f12 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27274ba5bb951f0b expref: 20 pid: 5834 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265250.598534:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a103fad6600/0x27274ba5bb951f12 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27274ba5bb951f0b expref: 20 pid: 5834 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265250.598551:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265250.598578:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10118e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:871daf34-1206-40e7-bd71-78303abe4d37+20:3315:x1876180414282624:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265250.598585:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789265250.598625:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789265250.598630:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:871daf34-1206-40e7-bd71-78303abe4d37+19:3315:x1876180414282752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789265250.598637:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265250.598642:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1017262400/0x27274ba5bb951ee8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27274ba5bb951ee1 expref: 19 pid: 5835 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265250.598650:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1017262400/0x27274ba5bb951ee8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27274ba5bb951ee1 expref: 19 pid: 5835 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265250.598659:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265250.598680:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:871daf34-1206-40e7-bd71-78303abe4d37+19:3315:x1876180414282752:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265250.598686:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789265250.598720:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10091e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:871daf34-1206-40e7-bd71-78303abe4d37:3315:1876180414282752:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789265250.598738:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10091eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:871daf34-1206-40e7-bd71-78303abe4d37:3315:1876180414282624:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789265250.599011:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789265250.599021:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c0d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:871daf34-1206-40e7-bd71-78303abe4d37+3:11154:x1876180414282496:12345-0@lo:104: 00010000:00010000:0.0:1789265250.599031:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff8a1000031e00/0x27274ba5bb951eb7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27274ba5bb951ebe expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265250.599093:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789265250.599098:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c0d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:871daf34-1206-40e7-bd71-78303abe4d37+3:11154:x1876180414282496:12345-0@lo:104: Request processed in 80us (3046us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265250.599104:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1789265250.599164:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265250.599168:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff8a1000031e00/0x27274ba5bb951eb7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27274ba5bb951ebe expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265250.599175:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1000031e00 already unused, calling callback (ffffffffc1ba2c20) 10000000:00010000:1.0:1789265250.599179:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff8a1000031e00/0x27274ba5bb951eb7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x27274ba5bb951ebe expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265250.599185:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff8a1000031e00/0x27274ba5bb951eb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x27274ba5bb951ebe expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265250.599191:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff8a1000031e00/0x27274ba5bb951eb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x27274ba5bb951ebe expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265250.599195:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789265250.599223:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff8a1000031e00/0x27274ba5bb951eb7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951ebe expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265250.599229:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789265250.599244:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff8a1000031e00/0x27274ba5bb951eb7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951ebe expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265250.599250:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff8a1000031e00/0x27274ba5bb951eb7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951ebe expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265250.599265:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265250.599267:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265250.599268:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265250.599278:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:871daf34-1206-40e7-bd71-78303abe4d37:3317:1876180414282880:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789265250.599312:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265250.599384:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414282880 00000100:00100000:1.0:1789265250.599389:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414282880 00010000:00010000:1.0:1789265250.599412:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a101b596e00/0x27274ba5bb951ebe lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27274ba5bb951eb7 expref: 19 pid: 5835 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265250.599435:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789265250.599441:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:871daf34-1206-40e7-bd71-78303abe4d37+19:3317:x1876180414282880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789265250.599449:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265250.599453:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a101b596e00/0x27274ba5bb951ebe lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27274ba5bb951eb7 expref: 19 pid: 5835 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265250.599470:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a101b596e00/0x27274ba5bb951ebe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27274ba5bb951eb7 expref: 19 pid: 5835 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265250.599481:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265250.599507:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:871daf34-1206-40e7-bd71-78303abe4d37+19:3317:x1876180414282880:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265250.599513:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789265250.599539:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:871daf34-1206-40e7-bd71-78303abe4d37:3317:1876180414282880:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789265250.601978:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265250.602160:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265250.602187:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397472000 00000100:00100000:1.0:1789265250.602195:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397472000 00010000:00010000:1.0:1789265250.602229:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1017263000/0x27274ba5bb951f3c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efd3b expref: 13 pid: 5834 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265250.602257:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397472128 00000100:00100000:1.0:1789265250.602260:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397472128 00010000:00010000:1.0:1789265250.602287:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1017262e00/0x27274ba5bb951f27 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efd03 expref: 14 pid: 5833 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265250.602307:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 28 00000100:00100000:1.0:1789265250.602317:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c1230cd-a81b-4bcc-a532-e24f5353fef4+14:2350:x1876180397472000:12345-192.168.203.37@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1789265250.602419:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 29 00000100:00100000:3.0:1789265250.602428:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+14:2351:x1876180397472128:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265250.604713:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265250.604732:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1017263000/0x27274ba5bb951f3c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efd3b expref: 14 pid: 5834 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265250.604753:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1017263000/0x27274ba5bb951f3c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efd3b expref: 14 pid: 5834 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265250.604778:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265250.604851:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c1230cd-a81b-4bcc-a532-e24f5353fef4+14:2350:x1876180397472000:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 2533us (2878us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265250.604862:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 28 00010000:00010000:2.0:1789265250.605634:0:11154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a103fad6600/0x27274ba5bb951f12 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27274ba5bb951f0b expref: 18 pid: 5834 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265250.605673:0:11154:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1008755880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11154:1876180414282240:0@lo:104: 00010000:00010000:2.0:1789265250.605708:0:11154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1017262400/0x27274ba5bb951ee8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27274ba5bb951ee1 expref: 17 pid: 5835 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265250.605717:0:11154:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1008754700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11154:1876180414282368:0@lo:104: 00010000:00010000:2.0:1789265250.605728:0:11154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a101b596e00/0x27274ba5bb951ebe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27274ba5bb951eb7 expref: 16 pid: 5835 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265250.605736:0:11154:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1008755c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11154:1876180414282496:0@lo:104: 00010000:00010000:2.0:1789265250.605751:0:11154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1017263000/0x27274ba5bb951f3c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efd3b expref: 13 pid: 5834 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265250.605760:0:11154:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1008757800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11154:1876180414281984:192.168.203.37@tcp:104: 00000100:00100000:2.0:1789265250.605768:0:11154:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1008755180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11154:1876180414282112:192.168.203.37@tcp:104: 00010000:00010000:2.0:1789265250.605799:0:11154:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a103fad6c00/0x27274ba5bb951f58 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265250.606410:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265250.606419:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1017262e00/0x27274ba5bb951f27 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efd03 expref: 12 pid: 5833 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265250.606432:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1017262e00/0x27274ba5bb951f27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efd03 expref: 12 pid: 5833 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265250.606448:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1017262e00/0x27274ba5bb951f27 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efd03 expref: 12 pid: 5833 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265250.606481:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a103fad6c00/0x27274ba5bb951f58 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265250.606488:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a103fad6c00/0x27274ba5bb951f58 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265250.606503:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a103fad6c00/0x27274ba5bb951f58 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265250.606510:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a103fad6c00/0x27274ba5bb951f58 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265250.606517:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a103fad6c00/0x27274ba5bb951f58 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265250.606523:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a103fad6c00/0x27274ba5bb951f58 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265250.606530:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad6c00 already unused, calling callback (ffffffffc1581350) 00010000:00010000:3.0:1789265250.606534:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a103fad6c00/0x27274ba5bb951f58 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265250.606542:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a103fad6c00/0x27274ba5bb951f58 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265250.606735:0:11154:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a103fad6c00/0x27274ba5bb951f58 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265250.606744:0:11154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a103fad6c00/0x27274ba5bb951f58 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265250.607883:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a103fad6c00/0x27274ba5bb951f58 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265250.607906:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a103fad6c00/0x27274ba5bb951f58 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265250.607934:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265250.608042:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+11:2351:x1876180397472128:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 5612us (5880us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265250.608053:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 29 00010000:00010000:0.0:1789265250.611574:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265250.612358:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414283008:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789265250.612426:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265250.612503:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414283008 00000100:00100000:3.0:1789265250.612511:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414283008 00000100:00100000:3.0:1789265250.612559:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789265250.612568:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c0d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876180414283008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789265250.612600:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789265250.612835:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c0d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876180414283008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 267us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265250.612842:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1789265250.612946:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a0f02da0a80 x1876180414283008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265266 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265250.612976:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414283008:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789265251.634571:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265252.211408:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265252.211647:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397472256 00000100:00100000:0.0:1789265252.211658:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397472256 00000100:00100000:0.0:1789265252.212417:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 226 00000100:00100000:0.0:1789265252.212432:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1230cd-a81b-4bcc-a532-e24f5353fef4+11:5588:x1876180397472256:12345-192.168.203.37@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789265252.212467:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265252.212487:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1017262600/0x27274ba5bb951f5f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x73b61075d99efd65 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265252.212515:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1017262600/0x27274ba5bb951f5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efd65 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265252.212526:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1017262600/0x27274ba5bb951f5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efd65 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265252.212536:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1017262600, rc 0) 00000100:00100000:0.0:1789265252.212599:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1230cd-a81b-4bcc-a532-e24f5353fef4+12:5588:x1876180397472256:12345-192.168.203.37@tcp:101:ll_cfg_requeue.0 Request processed in 171us (1201us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265252.212607:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 226 00000100:00100000:1.0:1789265252.215975:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265252.216060:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397472384 00000100:00100000:2.0:1789265252.216070:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397472384 00000100:00100000:2.0:1789265252.216150:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 227 00000100:00100000:2.0:1789265252.216161:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+12:5588:x1876180397472384:12345-192.168.203.37@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265252.216480:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+12:5588:x1876180397472384:12345-192.168.203.37@tcp:501:ll_cfg_requeue.0 Request processed in 320us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265252.216489:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 227 00000100:00100000:1.0:1789265252.220525:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265252.222011:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397472512 00000100:00100000:2.0:1789265252.222026:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397472512 00000100:00100000:2.0:1789265252.222104:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 228 00000100:00100000:2.0:1789265252.222115:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1230cd-a81b-4bcc-a532-e24f5353fef4+12:5588:x1876180397472512:12345-192.168.203.37@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265252.222342:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1230cd-a81b-4bcc-a532-e24f5353fef4+12:5588:x1876180397472512:12345-192.168.203.37@tcp:503:ll_cfg_requeue.0 Request processed in 228us (1824us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265252.222352:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 228 00000100:00100000:1.0:1789265252.244987:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265252.245026:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397472640 00000100:00100000:1.0:1789265252.245036:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397472640 00000100:00100000:1.0:1789265252.245095:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 229 00000100:00100000:1.0:1789265252.245104:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1230cd-a81b-4bcc-a532-e24f5353fef4+12:5588:x1876180397472640:12345-192.168.203.37@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789265252.245120:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265252.245135:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a101b597c00/0x27274ba5bb951f66 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x73b61075d99efd6c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265252.245173:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a101b597c00/0x27274ba5bb951f66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efd6c expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265252.245185:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a101b597c00/0x27274ba5bb951f66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efd6c expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265252.245194:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a101b597c00, rc 0) 00000100:00100000:1.0:1789265252.245250:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1230cd-a81b-4bcc-a532-e24f5353fef4+13:5588:x1876180397472640:12345-192.168.203.37@tcp:101:ll_cfg_requeue.0 Request processed in 147us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265252.245257:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 229 00000100:00100000:0.0:1789265252.250945:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265252.251013:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397472768 00000100:00100000:1.0:1789265252.251023:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397472768 00000100:00100000:1.0:1789265252.251124:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 230 00000100:00100000:1.0:1789265252.251134:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+13:5588:x1876180397472768:12345-192.168.203.37@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265252.251428:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+13:5588:x1876180397472768:12345-192.168.203.37@tcp:501:ll_cfg_requeue.0 Request processed in 295us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265252.251436:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 230 00000100:00100000:1.0:1789265252.265265:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265252.265352:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397472896 00000100:00100000:2.0:1789265252.265362:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397472896 00000100:00100000:2.0:1789265252.265418:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 231 00000100:00100000:2.0:1789265252.265428:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1230cd-a81b-4bcc-a532-e24f5353fef4+13:5588:x1876180397472896:12345-192.168.203.37@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265252.265646:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1230cd-a81b-4bcc-a532-e24f5353fef4+13:5588:x1876180397472896:12345-192.168.203.37@tcp:503:ll_cfg_requeue.0 Request processed in 219us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265252.265654:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 231 10000000:01000000:3.0:1789265252.407819:0:5837:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789265252.407827:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a103bd8f000 from 7 10000000:01000000:3.0:1789265252.407833:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789265252.407883:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a1042045c00/0x27274ba5bb951f6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265252.407893:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff8a1042045c00/0x27274ba5bb951f6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265252.407904:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff8a1042045c00/0x27274ba5bb951f6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265252.407930:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103fa64e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414283136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789265252.407998:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265252.408194:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a102eb77540 going to sleep for 11 seconds 00000100:00100000:1.0:1789265252.408504:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414283136 00000100:00100000:1.0:1789265252.408512:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414283136 00000100:00100000:1.0:1789265252.408556:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1789265252.408564:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+16:5837:x1876180414283136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789265252.408578:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265252.408591:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a101b596400/0x27274ba5bb951f74 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x27274ba5bb951f6d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265252.408626:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a101b596400/0x27274ba5bb951f74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27274ba5bb951f6d expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265252.408637:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a101b596400/0x27274ba5bb951f74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb951f6d expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265252.408646:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a101b596400, rc 0) 00000100:00100000:1.0:1789265252.408740:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+17:5837:x1876180414283136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 176us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265252.408747:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1789265252.408894:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103fa64e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414283136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265252.408909:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff8a1042045c00/0x27274ba5bb951f6d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951f74 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265252.408918:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff8a1042045c00/0x27274ba5bb951f6d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27274ba5bb951f74 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265252.408972:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103fa64e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414283264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265252.408998:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265252.409062:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a102eb77540 going to sleep for 11 seconds 00000100:00100000:1.0:1789265252.409150:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414283264 00000100:00100000:1.0:1789265252.409155:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414283264 00000100:00100000:1.0:1789265252.409217:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1789265252.409225:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+17:5837:x1876180414283264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265252.409481:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+17:5837:x1876180414283264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 256us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265252.409489:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1789265252.409553:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103fa64e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414283264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265252.409593:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414283392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265252.409633:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265252.409758:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414283392 00000100:00100000:3.0:1789265252.409763:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414283392 00000100:00100000:3.0:1789265252.409850:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1789265252.409857:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+17:5837:x1876180414283392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789265252.409993:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+17:5837:x1876180414283392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 135us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265252.410001:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1789265252.410250:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10107f2840 going to sleep for 11 seconds 00000100:00100000:2.0:1789265252.410266:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414283392:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789265252.411132:0:11210:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789265252.411311:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789265252.411329:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789265252.411339:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a1042045c00/0x27274ba5bb951f6d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951f74 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265252.411349:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff8a1042045c00/0x27274ba5bb951f6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951f74 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265252.411359:0:5837:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789265252.411361:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a103c151000 from 7 10000000:01000000:2.0:1789265252.411364:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789265252.411399:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a103fad7000/0x27274ba5bb951f7b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265252.411406:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff8a103fad7000/0x27274ba5bb951f7b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265252.411417:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff8a103fad7000/0x27274ba5bb951f7b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265252.411436:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414283520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789265252.411498:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265252.411594:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10107f2840 going to sleep for 11 seconds 00000100:00100000:3.0:1789265252.411633:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414283520 00000100:00100000:3.0:1789265252.411639:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414283520 00000100:00100000:3.0:1789265252.411712:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1789265252.411721:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+17:5837:x1876180414283520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265252.411732:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265252.411743:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1042044000/0x27274ba5bb951f82 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x27274ba5bb951f7b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265252.411968:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1042044000/0x27274ba5bb951f82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27274ba5bb951f7b expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265252.411987:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1042044000/0x27274ba5bb951f82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb951f7b expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265252.411997:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1042044000, rc 0) 00000100:00100000:3.0:1789265252.412045:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+18:5837:x1876180414283520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 325us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265252.412052:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1789265252.412122:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414283520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789265252.412141:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff8a103fad7000/0x27274ba5bb951f7b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951f82 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265252.412151:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff8a103fad7000/0x27274ba5bb951f7b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x27274ba5bb951f82 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265252.412200:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414283648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265252.412224:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265252.412339:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414283648 00000100:00100000:1.0:1789265252.412344:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414283648 00000100:00100000:1.0:1789265252.412364:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1789265252.412370:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+18:5837:x1876180414283648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265252.412604:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+18:5837:x1876180414283648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 233us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265252.412611:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1789265252.412715:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10107f2840 going to sleep for 11 seconds 00000100:00100000:2.0:1789265252.412728:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414283648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265252.412752:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414283776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265252.412786:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265252.412842:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10107f2840 going to sleep for 11 seconds 00000100:00100000:1.0:1789265252.412882:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414283776 00000100:00100000:1.0:1789265252.412886:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414283776 00000100:00100000:1.0:1789265252.412948:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1789265252.412955:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+18:5837:x1876180414283776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789265252.413214:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+18:5837:x1876180414283776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 260us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265252.413222:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1789265252.413282:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414283776:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789265252.415880:0:11211:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789265252.416150:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789265252.416170:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789265252.416182:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a103fad7000/0x27274ba5bb951f7b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951f82 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265252.416194:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff8a103fad7000/0x27274ba5bb951f7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951f82 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265252.416206:0:5837:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789265252.416209:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a10202ad000 from 7 10000000:01000000:2.0:1789265252.416212:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789265252.416263:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a103fad6e00/0x27274ba5bb951f89 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265252.416282:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff8a103fad6e00/0x27274ba5bb951f89 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265252.416294:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff8a103fad6e00/0x27274ba5bb951f89 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265252.416318:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414283904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789265252.416378:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265252.416462:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10107f2840 going to sleep for 11 seconds 00000100:00100000:3.0:1789265252.416585:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414283904 00000100:00100000:3.0:1789265252.416593:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414283904 00000100:00100000:3.0:1789265252.416682:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1789265252.416692:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+18:5837:x1876180414283904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265252.416705:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265252.416717:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1042044200/0x27274ba5bb951f90 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x27274ba5bb951f89 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265252.416739:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1042044200/0x27274ba5bb951f90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27274ba5bb951f89 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265252.416750:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1042044200/0x27274ba5bb951f90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb951f89 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265252.416759:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1042044200, rc 0) 00000100:00100000:3.0:1789265252.416806:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+19:5837:x1876180414283904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265252.416813:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1789265252.416881:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414283904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789265252.416894:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff8a103fad6e00/0x27274ba5bb951f89 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951f90 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265252.416903:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff8a103fad6e00/0x27274ba5bb951f89 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x27274ba5bb951f90 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265252.416949:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414284032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265252.416973:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265252.417029:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10107f2840 going to sleep for 11 seconds 00000100:00100000:1.0:1789265252.417064:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414284032 00000100:00100000:1.0:1789265252.417068:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414284032 00000100:00100000:1.0:1789265252.417109:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1789265252.417116:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+19:5837:x1876180414284032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265252.417518:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+19:5837:x1876180414284032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 401us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265252.417526:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1789265252.417591:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414284032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265252.417620:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414284160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265252.417658:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265252.417716:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10107f2840 going to sleep for 11 seconds 00000100:00100000:3.0:1789265252.417778:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414284160 00000100:00100000:3.0:1789265252.417789:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414284160 00000100:00100000:1.0:1789265252.417889:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1789265252.417897:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+19:5837:x1876180414284160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789265252.418040:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+19:5837:x1876180414284160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 144us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265252.418047:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1789265252.418148:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414284160:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789265252.420048:0:11212:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1789265252.420200:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1789265252.420219:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789265252.420242:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a103fad6e00/0x27274ba5bb951f89 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951f90 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265252.420254:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff8a103fad6e00/0x27274ba5bb951f89 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951f90 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265252.672011:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265253.684263:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265254.204271:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789265254.204293:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414284288:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789265254.204355:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265254.204492:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414284288 00000100:00100000:2.0:1789265254.204501:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414284288 00000100:00100000:2.0:1789265254.204572:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789265254.204581:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008e24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414284288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789265254.204615:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789265254.204663:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008e24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414284288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265254.204671:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:2.0:1789265254.204711:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a103c0d6300 x1876180414284288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265270 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265254.204727:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414284288:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789265254.204809:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789265254.707793:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789265254.828295:0:11352:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg337-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1789265255.218380:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1876180414284672:0@lo:400:kworker.0 00000100:00100000:2.0:1789265255.218462:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265255.218524:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789265255.218531:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876180414284544:0@lo:400:kworker.0 00000100:00100000:2.0:1789265255.218553:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265255.218568:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1008755180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414285056:0@lo:400:kworker.0 00000100:00100000:2.0:1789265255.218589:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265255.218675:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414284800:0@lo:400:kworker.0 00000100:00100000:3.0:1789265255.218703:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265255.218731:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789265255.218737:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:871daf34-1206-40e7-bd71-78303abe4d37:3315:1876180414284416:0@lo:400:kworker.0 00000100:00100000:3.0:1789265255.218762:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265255.218780:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1876180414284928:0@lo:400:kworker.0 00000100:00100000:3.0:1789265255.218800:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265255.218829:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414284672 00000100:00100000:3.0:1789265255.218837:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414284672 00000100:00100000:3.0:1789265255.218883:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414284544 00000100:00100000:3.0:1789265255.218886:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414284544 00000100:00100000:3.0:1789265255.218898:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414284928 00000100:00100000:3.0:1789265255.218901:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414284928 00000100:00100000:3.0:1789265255.218915:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789265255.218922:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008757800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1876180414284672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265255.218972:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008757800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1876180414284672:12345-0@lo:400:kworker.0 Request processed in 50us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265255.218979:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789265255.218994:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789265255.219001:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008755c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876180414284544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265255.219026:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008755c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876180414284544:12345-0@lo:400:kworker.0 Request processed in 27us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265255.219046:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789265255.219059:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789265255.219064:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103fa64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876180414284928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265255.219127:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103fa64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876180414284928:12345-0@lo:400:kworker.0 Request processed in 63us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265255.219132:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:3.0:1789265255.219147:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265255.219179:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1876180414284928:0@lo:400:kworker.0 00000100:00100000:3.0:1789265255.219208:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876180414284544:0@lo:400:kworker.0 00000100:00100000:3.0:1789265255.219217:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1876180414284672:0@lo:400:kworker.0 00000100:00100000:2.0:1789265255.219282:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414285056 00000100:00100000:2.0:1789265255.219286:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414285056 00000100:00100000:2.0:1789265255.219326:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414284800 00000100:00100000:2.0:1789265255.219329:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414284800 00000100:00100000:2.0:1789265255.219344:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789265255.219349:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008754700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1876180414285056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265255.219385:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008754700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1876180414285056:12345-0@lo:400:kworker.0 Request processed in 35us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265255.219390:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789265255.219400:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789265255.219412:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103fa65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414284800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265255.219456:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103fa65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414284800:12345-0@lo:400:kworker.0 Request processed in 44us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265255.219461:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:3.0:1789265255.219524:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789265255.219550:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a103c0d7800 x1876180414284800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265255.219561:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414284800:0@lo:400:kworker.0 00010000:00080000:3.0:1789265255.219582:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1008755180 x1876180414285056/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265255.219589:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1008755180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414285056:0@lo:400:kworker.0 00000100:00100000:1.0:1789265255.219743:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414284416 00000100:00100000:1.0:1789265255.219748:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414284416 00000100:00100000:1.0:1789265255.219789:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1789265255.219796:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+19:3315:x1876180414284416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265255.219839:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+19:3315:x1876180414284416:12345-0@lo:400:kworker.0 Request processed in 44us (1075us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265255.219845:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1789265255.220480:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:871daf34-1206-40e7-bd71-78303abe4d37:3315:1876180414284416:0@lo:400:kworker.0 00000100:00100000:0.0:1789265255.668868:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265255.668913:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265255.668945:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265255.669048:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397473280 00000100:00100000:2.0:1789265255.669058:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397473280 00000100:00100000:2.0:1789265255.669144:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397473152 00000100:00100000:2.0:1789265255.669148:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397473152 00000100:00100000:1.0:1789265255.669178:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397473024 00000100:00100000:1.0:1789265255.669183:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397473024 00000100:00100000:2.0:1789265255.669189:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 84 00000100:00100000:2.0:1789265255.669202:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008e27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+5:2349:x1876180397473280:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789265255.669222:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 242 00000100:00100000:1.0:1789265255.669232:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+13:2349:x1876180397473024:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789265255.669284:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008e27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+5:2349:x1876180397473280:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 85us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265255.669292:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 84 00000100:00100000:2.0:1789265255.669308:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 85 00000100:00100000:2.0:1789265255.669315:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008e25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:2349:x1876180397473152:12345-192.168.203.37@tcp:400:kworker.0 00000100:00080000:0.0:1789265255.669814:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265255.671622:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+13:2349:x1876180397473024:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 2381us (2753us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265255.671635:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 242 00000100:00100000:2.0:1789265255.676483:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008e25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:2349:x1876180397473152:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 7154us (7523us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265255.676500:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 85 00010000:00010000:0.0:1789265255.730253:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265255.730396:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414285184:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789265255.730492:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265255.730618:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414285184 00000100:00100000:2.0:1789265255.730626:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414285184 00000100:00100000:2.0:1789265255.730675:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789265255.730684:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103fa64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876180414285184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789265255.730728:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00010000:00080000:0.0:1789265255.742433:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a0f02da0a80 x1876180414285184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265271 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265255.742464:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414285184:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789265255.743230:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103fa64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876180414285184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 12544us (12748us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265255.743243:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:3.0:1789265256.757585:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265257.780278:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789265258.565635:0:11452:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 22:07:37 (1789265257) === 00010000:00010000:3.0:1789265258.805659:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265258.849531:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265258.849586:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265258.849744:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397473536 00000100:00100000:2.0:1789265258.849754:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397473536 00000100:00100000:2.0:1789265258.849826:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 0 00000100:00100000:2.0:1789265258.849846:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008e27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:9658:x1876180397473536:12345-192.168.203.37@tcp:700:mkdir.0 00000100:00100000:2.0:1789265258.849929:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008e27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:9658:x1876180397473536:12345-192.168.203.37@tcp:700:mkdir.0 Request processed in 93us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265258.849937:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 0 00000100:00100000:3.0:1789265258.850352:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397473408 00000100:00100000:3.0:1789265258.850358:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397473408 00000100:00100000:3.0:1789265258.850414:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 14 00000100:00100000:3.0:1789265258.850423:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008e25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:2351:x1876180397473408:12345-192.168.203.37@tcp:41:mkdir.0 00000004:00000024:3.0:1789265258.850453:0:5840:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789265258.850518:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008e25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:2351:x1876180397473408:12345-192.168.203.37@tcp:41:mkdir.0 Request processed in 96us (997us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265258.850525:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 14 00000100:00080000:0.0:1789265258.850966:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265258.866700:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265258.866884:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397473792 00000100:00100000:3.0:1789265258.866894:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397473792 00000100:00100000:3.0:1789265258.866956:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 15 00000100:00100000:3.0:1789265258.866970:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008e27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:9658:x1876180397473792:12345-192.168.203.37@tcp:36:mkdir.0 00010000:00010000:3.0:1789265258.867038:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265258.867136:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262800/0x27274ba5bb951e78 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efcee expref: 6 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265258.867156:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a101b706c00) 00010000:00010000:3.0:1789265258.867167:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789265258.867532:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1042045000/0x27274ba5bb951f97 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265258.867547:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1042045000/0x27274ba5bb951f97 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265258.867557:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1042045000/0x27274ba5bb951f97 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265258.867570:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421eaa00/0x27274ba5bb951f9e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265258.867590:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421eaa00/0x27274ba5bb951f9e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265258.867598:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421eaa00/0x27274ba5bb951f9e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265258.868781:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1789265258.868794:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1042045000/0x27274ba5bb951f97 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265258.868803:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1042045000/0x27274ba5bb951f97 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265258.868810:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1042045000/0x27274ba5bb951f97 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265258.868817:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1042045000 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789265258.868821:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1042045000/0x27274ba5bb951f97 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265258.868828:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1042045000/0x27274ba5bb951f97 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265258.868841:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1032d00d00) 00010000:00010000:3.0:1789265258.868844:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265258.868848:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1042045000/0x27274ba5bb951f97 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265258.868855:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1042045000/0x27274ba5bb951f97 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789265258.868883:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b57e6c07 reply state 000000001bdf43eb transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421eaa00/0x27274ba5bb951f9e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265258.868891:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789265258.868983:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008e27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+7:9658:x1876180397473792:12345-192.168.203.37@tcp:36:mkdir.0 Request processed in 2016us (2291us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1789265258.868991:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 15 00010000:00010000:1.0:1789265258.872696:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421eaa00/0x27274ba5bb951f9e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265258.872713:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421eaa00/0x27274ba5bb951f9e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265258.872721:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421eaa00/0x27274ba5bb951f9e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265258.872727:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a10421eaa00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789265258.872733:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421eaa00/0x27274ba5bb951f9e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265258.872741:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421eaa00/0x27274ba5bb951f9e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265258.872777:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8a1032d00700) 00010000:00010000:1.0:1789265258.872780:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265258.872785:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421eaa00/0x27274ba5bb951f9e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265258.872792:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421eaa00/0x27274ba5bb951f9e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265258.898791:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265258.899108:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397473920 00000100:00100000:3.0:1789265258.899118:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397473920 00000100:00100000:3.0:1789265258.899184:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 16 00000100:00100000:3.0:1789265258.899195:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008e26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:9660:x1876180397473920:12345-192.168.203.37@tcp:101:chmod.0 00010000:00010000:3.0:1789265258.899218:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265258.899241:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421ea400/0x27274ba5bb951fa5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99efd73 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265258.899327:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421eac00/0x27274ba5bb951fac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265258.899342:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421eac00/0x27274ba5bb951fac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265258.899353:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421eac00/0x27274ba5bb951fac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265258.899385:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789265258.899389:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789265258.899679:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421eac00/0x27274ba5bb951fac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265258.899726:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421ea400/0x27274ba5bb951fa5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efd73 expref: 8 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265258.899749:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421eac00/0x27274ba5bb951fac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efd73 expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265258.899758:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1032d00d00) 00010000:00010000:3.0:1789265258.899761:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789265258.899764:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a10421eac00, rc 0) 00000100:00100000:3.0:1789265258.899831:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008e26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+7:9660:x1876180397473920:12345-192.168.203.37@tcp:101:chmod.0 Request processed in 637us (1049us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265258.899847:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 16 00000100:00100000:3.0:1789265258.907144:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265258.907508:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397474176 00000100:00100000:2.0:1789265258.907519:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397474176 00000100:00100000:2.0:1789265258.907578:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 17 00000100:00100000:2.0:1789265258.907588:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c0d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+7:9660:x1876180397474176:12345-192.168.203.37@tcp:36:chmod.0 00010000:00010000:2.0:1789265258.907637:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265258.907664:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421eac00/0x27274ba5bb951fac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efd73 expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265258.907687:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1032d00d00) 00010000:00010000:2.0:1789265258.907697:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789265258.907720:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb951fb3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265258.907731:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb951fb3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265258.907740:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb951fb3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789265258.908290:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eb6c5596 reply state 0000000093c4301f transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb951fb3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265258.908312:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789265258.908321:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789265258.909290:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c0d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+8:9660:x1876180397474176:12345-192.168.203.37@tcp:36:chmod.0 Request processed in 1696us (2149us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1789265258.909302:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 17 00010000:00010000:3.0:1789265258.910743:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb951fb3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265258.910757:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb951fb3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265258.910764:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb951fb3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265258.910770:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad6a00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789265258.910774:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb951fb3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265258.910781:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb951fb3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265258.910811:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1012931100) 00010000:00010000:3.0:1789265258.910814:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789265258.910819:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb951fb3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265258.910825:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb951fb3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265258.935747:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265258.936029:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397474304 00000100:00100000:2.0:1789265258.936041:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397474304 00000100:00100000:2.0:1789265258.936280:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 18 00000100:00100000:2.0:1789265258.936292:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c0d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+7:9661:x1876180397474304:12345-192.168.203.37@tcp:101:chown.0 00010000:00010000:2.0:1789265258.936318:0:7934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265258.936342:0:7934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb951fba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99efd7a expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265258.936815:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6400/0x27274ba5bb951fc1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265258.936832:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6400/0x27274ba5bb951fc1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265258.936906:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6400/0x27274ba5bb951fc1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265258.936942:0:7934:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789265258.936946:0:7934:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789265258.936982:0:7934:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6400/0x27274ba5bb951fc1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265258.937010:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb951fba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efd7a expref: 9 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265258.937047:0:7934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6400/0x27274ba5bb951fc1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efd7a expref: 8 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265258.937056:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1012931800) 00010000:00010000:2.0:1789265258.937059:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789265258.937062:0:7934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fad6400, rc 0) 00000100:00100000:2.0:1789265258.937295:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c0d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+8:9661:x1876180397474304:12345-192.168.203.37@tcp:101:chown.0 Request processed in 1004us (1556us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265258.937304:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 18 00000100:00100000:2.0:1789265258.947838:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265258.948041:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397474432 00000100:00100000:3.0:1789265258.948054:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397474432 00000100:00100000:3.0:1789265258.948139:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 19 00000100:00100000:3.0:1789265258.948151:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008755880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+8:9661:x1876180397474432:12345-192.168.203.37@tcp:101:chown.0 00010000:00010000:3.0:1789265258.948171:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265258.948194:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421ea400/0x27274ba5bb951fc8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99efd81 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265258.948270:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421eb600/0x27274ba5bb951fcf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265258.948285:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421eb600/0x27274ba5bb951fcf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265258.948296:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421eb600/0x27274ba5bb951fcf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265258.948312:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421eb400/0x27274ba5bb951fd6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265258.948319:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421eb400/0x27274ba5bb951fd6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265258.948340:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421eb400/0x27274ba5bb951fd6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265258.948458:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421eac00/0x27274ba5bb951fdd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265258.948466:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421eac00/0x27274ba5bb951fdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265258.948472:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421eac00/0x27274ba5bb951fdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265258.948505:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789265258.948508:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789265258.948532:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421eac00/0x27274ba5bb951fdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265258.948543:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421eb600/0x27274ba5bb951fcf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265258.948550:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421eb600/0x27274ba5bb951fcf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265258.948557:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421eb600/0x27274ba5bb951fcf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265258.948562:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a10421eb600 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789265258.948566:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421eb600/0x27274ba5bb951fcf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265258.948573:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421eb600/0x27274ba5bb951fcf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265258.948593:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1012931800) 00010000:00010000:3.0:1789265258.948596:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265258.948600:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421eb600/0x27274ba5bb951fcf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265258.948606:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421eb600/0x27274ba5bb951fcf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265258.948632:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421eb400/0x27274ba5bb951fd6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265258.948638:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421eb400/0x27274ba5bb951fd6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265258.948642:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421eb400/0x27274ba5bb951fd6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265258.948647:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a10421eb400 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789265258.948649:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421eb400/0x27274ba5bb951fd6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265258.948654:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421eb400/0x27274ba5bb951fd6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265258.948661:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8a1032d00100) 00010000:00010000:3.0:1789265258.948663:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265258.948665:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421eb400/0x27274ba5bb951fd6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265258.948671:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421eb400/0x27274ba5bb951fd6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265258.948710:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421ea400/0x27274ba5bb951fc8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efd81 expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265258.948724:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421eac00/0x27274ba5bb951fdd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efd81 expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265258.948731:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8a1032d00b00) 00010000:00010000:3.0:1789265258.948733:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789265258.948736:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a10421eac00, rc 0) 00000100:00100000:3.0:1789265258.948801:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008755880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+9:9661:x1876180397474432:12345-192.168.203.37@tcp:101:chown.0 Request processed in 652us (973us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265258.948808:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 19 00000100:00100000:1.0:1789265258.953989:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265258.954210:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397474688 00000100:00100000:3.0:1789265258.954220:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397474688 00000100:00100000:3.0:1789265258.954286:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 20 00000100:00100000:3.0:1789265258.954296:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+9:9661:x1876180397474688:12345-192.168.203.37@tcp:36:chown.0 00010000:00010000:3.0:1789265258.954345:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265258.954369:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421eac00/0x27274ba5bb951fdd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efd81 expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265258.954384:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8a1032d00b00) 00010000:00010000:3.0:1789265258.954432:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789265258.954459:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421ea400/0x27274ba5bb951fe4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265258.954473:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421ea400/0x27274ba5bb951fe4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265258.954497:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421ea400/0x27274ba5bb951fe4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789265258.978639:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000004:00010000:1.0:1789265258.978774:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b2527f5f reply state 00000000eb647771 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421ea400/0x27274ba5bb951fe4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265258.978789:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789265258.978803:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1789265258.978925:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+9:9661:x1876180397474688:12345-192.168.203.37@tcp:36:chown.0 Request processed in 24626us (24940us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1789265258.978935:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 20 00000001:00080000:2.0:1789265258.979633:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00010000:00010000:1.0:1789265258.979686:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421ea400/0x27274ba5bb951fe4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265258.979697:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421ea400/0x27274ba5bb951fe4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265258.979705:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421ea400/0x27274ba5bb951fe4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265258.979711:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a10421ea400 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789265258.979725:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421ea400/0x27274ba5bb951fe4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265258.979752:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421ea400/0x27274ba5bb951fe4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265258.979767:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8a1032d00100) 00010000:00010000:1.0:1789265258.979770:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789265258.979775:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421ea400/0x27274ba5bb951fe4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265258.979781:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421ea400/0x27274ba5bb951fe4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265259.001172:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265259.001784:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397474816 00000100:00100000:3.0:1789265259.001795:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397474816 00000100:00100000:3.0:1789265259.001931:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 21 00000100:00100000:3.0:1789265259.001942:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10091eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:9662:x1876180397474816:12345-192.168.203.37@tcp:101:touch.500 00010000:00010000:3.0:1789265259.001967:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265259.001989:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421eac00/0x27274ba5bb951feb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99efd88 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789265259.003718:0:5841:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1677us 00010000:00010000:1.0:1789265259.023157:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb951ff2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265259.023178:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb951ff2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265259.023188:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb951ff2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265259.023203:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596800/0x27274ba5bb951ff9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265259.023210:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596800/0x27274ba5bb951ff9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265259.023215:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596800/0x27274ba5bb951ff9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265259.023750:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb952000 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265259.023761:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb952000 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265259.023768:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb952000 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265259.023790:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789265259.023793:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789265259.023892:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb952000 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265259.023905:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb951ff2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265259.023912:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb951ff2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265259.023919:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb951ff2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265259.023925:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b597800 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789265259.023929:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb951ff2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265259.023936:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb951ff2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265259.023947:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1012931800) 00010000:00010000:1.0:1789265259.023955:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265259.023959:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb951ff2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265259.023966:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb951ff2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265259.023978:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596800/0x27274ba5bb951ff9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265259.023983:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596800/0x27274ba5bb951ff9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265259.023990:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596800/0x27274ba5bb951ff9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265259.023995:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b596800 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789265259.023997:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596800/0x27274ba5bb951ff9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265259.024003:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596800/0x27274ba5bb951ff9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265259.024009:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8a101cdf4700) 00010000:00010000:1.0:1789265259.024012:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265259.024014:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596800/0x27274ba5bb951ff9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265259.024019:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596800/0x27274ba5bb951ff9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265259.024051:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421eac00/0x27274ba5bb951feb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efd88 expref: 8 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265259.024489:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb952000 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efd88 expref: 7 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265259.024500:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8a101cdf4400) 00010000:00010000:1.0:1789265259.024503:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789265259.024506:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a101b596600, rc 0) 00000100:00100000:1.0:1789265259.024614:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10091eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+7:9662:x1876180397474816:12345-192.168.203.37@tcp:101:touch.500 Request processed in 22673us (23449us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265259.024622:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 21 00000100:00100000:2.0:1789265259.029482:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265259.029599:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397475072 00000100:00100000:3.0:1789265259.029607:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397475072 00000100:00100000:3.0:1789265259.029657:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 22 00000100:00100000:3.0:1789265259.029667:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008755180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+7:9662:x1876180397475072:12345-192.168.203.37@tcp:101:touch.500 00010000:00010000:3.0:1789265259.029687:0:7934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265259.029706:0:7934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421eb400/0x27274ba5bb952007 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99efd8f expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265259.030041:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421eb600/0x27274ba5bb95200e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265259.030057:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421eb600/0x27274ba5bb95200e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265259.030070:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421eb600/0x27274ba5bb95200e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265259.030173:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421eaa00/0x27274ba5bb952015 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265259.030182:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421eaa00/0x27274ba5bb952015 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265259.030188:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421eaa00/0x27274ba5bb952015 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789265259.031489:0:7934:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:3.0:1789265259.031775:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421ea400/0x27274ba5bb95201c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265259.031789:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421ea400/0x27274ba5bb95201c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265259.031799:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421ea400/0x27274ba5bb95201c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265259.032059:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421eb600/0x27274ba5bb95200e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265259.032067:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421eb600/0x27274ba5bb95200e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265259.032134:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421eb600/0x27274ba5bb95200e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265259.032142:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a10421eb600 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789265259.032146:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421eb600/0x27274ba5bb95200e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265259.032166:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421eb600/0x27274ba5bb95200e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265259.032179:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8a101cdf4400) 00010000:00010000:3.0:1789265259.032182:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265259.032187:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421eb600/0x27274ba5bb95200e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265259.032194:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421eb600/0x27274ba5bb95200e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789265259.032218:0:7934:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000056250971 reply state 000000009ee3ebe2 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421eaa00/0x27274ba5bb952015 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265259.032227:0:7934:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789265259.032455:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421eb400/0x27274ba5bb952007 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efd8f expref: 10 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265259.032476:0:7934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421ea400/0x27274ba5bb95201c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efd8f expref: 9 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265259.032484:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8a1032d00b00) 00010000:00010000:3.0:1789265259.032487:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789265259.032489:0:7934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a10421ea400, rc 0) 00000100:00100000:3.0:1789265259.032603:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008755180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+10:9662:x1876180397475072:12345-192.168.203.37@tcp:101:touch.500 Request processed in 2937us (3131us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1789265259.032612:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 22 00000100:00100000:0.0:1789265259.037730:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00010000:00010000:3.0:1789265259.038370:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421eaa00/0x27274ba5bb952015 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265259.038467:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421eaa00/0x27274ba5bb952015 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265259.038476:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421eaa00/0x27274ba5bb952015 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265259.038482:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a10421eaa00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789265259.038487:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421eaa00/0x27274ba5bb952015 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265259.038494:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421eaa00/0x27274ba5bb952015 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265259.038512:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x94fd8476 (ffff8a1032d00800) 00010000:00010000:3.0:1789265259.038515:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265259.038519:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421eaa00/0x27274ba5bb952015 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265259.038525:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421eaa00/0x27274ba5bb952015 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265259.038633:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397475328 00000100:00100000:2.0:1789265259.038643:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397475328 00000100:00100000:2.0:1789265259.038714:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 23 00000100:00100000:2.0:1789265259.038723:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008e26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+9:9662:x1876180397475328:12345-192.168.203.37@tcp:36:touch.500 00010000:00010000:2.0:1789265259.038772:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265259.038787:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a10421ea400/0x27274ba5bb95201c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efd8f expref: 9 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265259.038799:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8a1032d00b00) 00010000:00010000:2.0:1789265259.038804:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789265259.038851:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb95202a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265259.038874:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb95202a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265259.038884:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb95202a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789265259.039014:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aa9b046c reply state 00000000f1264ccc transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb95202a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265259.039023:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789265259.039140:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008e26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+10:9662:x1876180397475328:12345-192.168.203.37@tcp:36:touch.500 Request processed in 417us (1416us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789265259.039146:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 23 00010000:00010000:3.0:1789265259.041905:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb95202a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265259.042003:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb95202a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265259.042011:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb95202a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265259.042017:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad6a00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789265259.042036:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb95202a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265259.042043:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb95202a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265259.042122:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265259.042203:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397475456 00000100:00100000:1.0:1789265259.042212:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397475456 00010000:00010000:3.0:1789265259.042218:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8a1012931600) 00010000:00010000:3.0:1789265259.042221:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265259.042226:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb95202a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265259.042232:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb95202a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265259.042275:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 24 00000100:00100000:1.0:1789265259.042285:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008e27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+10:9662:x1876180397475456:12345-192.168.203.37@tcp:101:touch.500 00010000:00010000:1.0:1789265259.042306:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265259.042323:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596200/0x27274ba5bb952031 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99efd96 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265259.042376:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596200/0x27274ba5bb952031 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efd96 expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265259.042385:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596200/0x27274ba5bb952031 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efd96 expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265259.042418:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8a101cdf4000) 00010000:00010000:1.0:1789265259.042421:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789265259.042434:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a101b596200, rc 0) 00000100:00100000:1.0:1789265259.042489:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008e27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+10:9662:x1876180397475456:12345-192.168.203.37@tcp:101:touch.500 Request processed in 205us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265259.042496:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 24 00000100:00100000:1.0:1789265259.046535:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265259.049802:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397475584 00000100:00100000:2.0:1789265259.049907:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397475584 00000100:00100000:2.0:1789265259.049961:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 16 00000100:00100000:2.0:1789265259.049969:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10091e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2347:x1876180397475584:12345-192.168.203.37@tcp:8:touch.500 00010000:00080000:2.0:1789265259.050001:0:6684:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 4b820fcb-1bab-4b78-bfa4-355c22a09cf8@192.168.203.37@tcp t0 exp 0000000000000000 cur 304 last 0 00000020:00000080:2.0:1789265259.050031:0:6684:0:(genops.c:1385:class_connect()) connect: client 4b820fcb-1bab-4b78-bfa4-355c22a09cf8, cookie 0x27274ba5bb952038 00002000:00100000:2.0:1789265259.050043:0:6684:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4b820fcb-1bab-4b78-bfa4-355c22a09cf8/ffff8a103fbde000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113969 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789265259.050066:0:6684:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789265259.050740:0:6684:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789265259.050774:0:6684:0:(import.c:65:import_set_state_nolock()) ffff8a103fbd8000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789265259.050961:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10091e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:2347:x1876180397475584:12345-192.168.203.37@tcp:8:touch.500 Request processed in 990us (4433us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265259.050970:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 16 00000100:00100000:3.0:1789265259.056873:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265259.056944:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397475712 00000100:00100000:2.0:1789265259.056954:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397475712 00000100:00100000:2.0:1789265259.057034:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 17 00000100:00100000:2.0:1789265259.057044:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c0d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:0:x1876180397475712:12345-192.168.203.37@tcp:2:touch.500 00000100:00080000:0.0:1789265259.057708:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1789265259.143354:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:2.0:1789265259.143369:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4b820fcb-1bab-4b78-bfa4-355c22a09cf8 00000100:00100000:3.0:1789265259.143578:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c0d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+5:0:x1876180397475712:12345-192.168.203.37@tcp:2:touch.500 Request processed in 86529us (86710us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1789265259.143590:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 17 00000100:00100000:0.0:1789265259.149241:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265259.149908:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397475968 00000100:00100000:3.0:1789265259.149919:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397475968 00000100:00100000:3.0:1789265259.149982:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 2 00000100:00100000:3.0:1789265259.149994:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008e25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+10:9662:x1876180397475968:12345-192.168.203.37@tcp:35:touch.500 00000100:00100000:2.0:1789265259.150504:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008e25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+11:9662:x1876180397475968:12345-192.168.203.37@tcp:35:touch.500 Request processed in 510us (1270us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1789265259.150517:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 2 00000100:00100000:1.0:1789265259.176273:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265259.176413:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397476096 00000100:00100000:2.0:1789265259.176423:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397476096 00000100:00100000:2.0:1789265259.176484:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 25 00000100:00100000:2.0:1789265259.176495:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1016d46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+11:9663:x1876180397476096:12345-192.168.203.37@tcp:101:rm.0 00010000:00010000:2.0:1789265259.176518:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265259.176539:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb95203f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99efd9d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265259.176603:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7e00/0x27274ba5bb952046 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265259.176617:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7e00/0x27274ba5bb952046 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265259.176629:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7e00/0x27274ba5bb952046 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265259.176663:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789265259.176667:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789265259.176704:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7e00/0x27274ba5bb952046 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265259.176753:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb95203f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efd9d expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265259.176770:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7e00/0x27274ba5bb952046 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efd9d expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265259.176779:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8a101cdf4400) 00010000:00010000:2.0:1789265259.176782:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789265259.176786:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fad7e00, rc 0) 00000100:00100000:2.0:1789265259.176848:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1016d46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+12:9663:x1876180397476096:12345-192.168.203.37@tcp:101:rm.0 Request processed in 354us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265259.176855:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 25 00000100:00100000:3.0:1789265259.186364:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265259.186500:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397476352 00000100:00100000:2.0:1789265259.186511:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397476352 00000100:00100000:2.0:1789265259.186571:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 26 00000100:00100000:2.0:1789265259.186581:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c0d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+12:9663:x1876180397476352:12345-192.168.203.37@tcp:101:rm.0 00010000:00010000:2.0:1789265259.186601:0:7934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265259.186621:0:7934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb95204d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99efda4 expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265259.186725:0:7934:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789265259.186911:0:7934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb95204d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efda4 expref: 14 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265259.186926:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1012931800) 00010000:00010000:2.0:1789265259.186929:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789265259.186941:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb95204d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efda4 expref: 14 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265259.186956:0:7934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fad7400, rc 0) 00000100:00100000:2.0:1789265259.187025:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c0d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+13:9663:x1876180397476352:12345-192.168.203.37@tcp:101:rm.0 Request processed in 446us (671us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1789265259.187033:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 26 00000100:00100000:0.0:1789265259.193586:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265259.193683:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397476480 00000100:00100000:2.0:1789265259.193692:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397476480 00000100:00100000:2.0:1789265259.193751:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 3 00000100:00100000:2.0:1789265259.193761:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1010f81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+13:9663:x1876180397476480:12345-192.168.203.37@tcp:37:rm.0 00000100:00100000:2.0:1789265259.200945:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1010f81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+13:9663:x1876180397476480:12345-192.168.203.37@tcp:37:rm.0 Request processed in 7175us (7357us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265259.200959:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 3 00000100:00100000:3.0:1789265259.205488:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265259.205567:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397476736 00000100:00100000:0.0:1789265259.205577:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397476736 00000100:00100000:0.0:1789265259.205636:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 4 00000100:00100000:0.0:1789265259.205647:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1010a41850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+13:9663:x1876180397476736:12345-192.168.203.37@tcp:35:rm.0 00000100:00100000:0.0:1789265259.205901:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1010a41850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+14:9663:x1876180397476736:12345-192.168.203.37@tcp:35:rm.0 Request processed in 254us (420us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1789265259.205909:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 4 00000100:00100000:0.0:1789265259.214223:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265259.219194:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397476992 00000100:00100000:3.0:1789265259.219210:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397476992 00000100:00100000:3.0:1789265259.219685:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 27 00000100:00100000:3.0:1789265259.219697:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1010f81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+14:9663:x1876180397476992:12345-192.168.203.37@tcp:101:rm.0 00010000:00010000:3.0:1789265259.219731:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265259.219763:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1042045000/0x27274ba5bb95205b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99efdab expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265259.219875:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9400/0x27274ba5bb952062 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265259.219889:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9400/0x27274ba5bb952062 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265259.219902:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9400/0x27274ba5bb952062 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265259.219913:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1789265259.220045:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1042045000/0x27274ba5bb95205b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efdab expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265259.220105:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9400/0x27274ba5bb952062 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efdab expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265259.220114:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8a101cdf4400) 00010000:00010000:3.0:1789265259.220117:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789265259.220120:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fae9400, rc 0) 00000100:00100000:3.0:1789265259.220193:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1010f81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+16:9663:x1876180397476992:12345-192.168.203.37@tcp:101:rm.0 Request processed in 499us (5980us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1789265259.220202:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 27 00000100:00100000:1.0:1789265259.228681:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265259.228836:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397477120 00000100:00100000:2.0:1789265259.228846:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397477120 00000100:00100000:2.0:1789265259.228905:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 28 00000100:00100000:2.0:1789265259.228917:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1016d47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+16:9663:x1876180397477120:12345-192.168.203.37@tcp:41:rm.0 00000004:00000024:2.0:1789265259.228976:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1789265259.229187:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1016d47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+16:9663:x1876180397477120:12345-192.168.203.37@tcp:41:rm.0 Request processed in 271us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265259.229195:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 28 00000100:00100000:0.0:1789265259.235756:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265259.236005:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397477248 00000100:00100000:2.0:1789265259.236015:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397477248 00000100:00100000:2.0:1789265259.236107:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 29 00000100:00100000:2.0:1789265259.236118:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1010f80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+16:9663:x1876180397477248:12345-192.168.203.37@tcp:101:rm.0 00010000:00010000:2.0:1789265259.236154:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265259.236176:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb952070 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99efdb2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265259.236245:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb952077 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265259.236259:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb952077 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265259.236281:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb952077 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265259.236297:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb95207e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265259.236305:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb95207e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265259.236311:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb95207e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265259.236428:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb952085 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265259.236436:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb952085 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265259.236444:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb952085 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265259.236471:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789265259.236481:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789265259.236501:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb952085 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265259.236513:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb952085 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265259.236521:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb952077 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265259.236828:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb952077 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265259.236847:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb952077 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265259.236853:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad6200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789265259.236864:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb952077 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265259.236873:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb952077 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265259.236886:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8a101cdf4400) 00010000:00010000:2.0:1789265259.236889:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265259.236892:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb952077 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265259.236899:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb952077 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265259.236913:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb95207e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265259.236929:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb95207e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265259.236935:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb95207e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265259.236940:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad6c00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789265259.236944:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb95207e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265259.236949:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb95207e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265259.236957:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x94fd8476 (ffff8a1012931300) 00010000:00010000:2.0:1789265259.236959:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265259.236962:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb95207e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265259.236967:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb95207e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265259.236999:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb952070 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efdb2 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265259.237013:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb952085 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efdb2 expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265259.237020:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8a101cdf4000) 00010000:00010000:2.0:1789265259.237023:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789265259.237031:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fad6600, rc 0) 00000100:00100000:2.0:1789265259.237147:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1010f80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+17:9663:x1876180397477248:12345-192.168.203.37@tcp:101:rm.0 Request processed in 1030us (1400us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265259.237156:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 29 00000100:00100000:0.0:1789265259.242029:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265259.242139:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397477504 00000100:00100000:1.0:1789265259.242150:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397477504 00000100:00100000:1.0:1789265259.242204:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 30 00000100:00100000:1.0:1789265259.242213:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1010f82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+17:9663:x1876180397477504:12345-192.168.203.37@tcp:36:rm.0 00010000:00010000:1.0:1789265259.242276:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789265259.242301:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb952085 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efdb2 expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265259.242324:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596200/0x27274ba5bb952031 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efd96 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265259.242335:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8a101cdf4000) 00010000:00010000:1.0:1789265259.242349:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7e00/0x27274ba5bb952046 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efd9d expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265259.242358:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8a101cdf4400) 00010000:00010000:1.0:1789265259.242360:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789265259.242381:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb95208c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265259.242405:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb95208c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265259.242429:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb95208c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265259.242444:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597000/0x27274ba5bb952093 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265259.242455:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597000/0x27274ba5bb952093 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265259.242461:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597000/0x27274ba5bb952093 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265259.242612:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb95209a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265259.242621:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb95209a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265259.242628:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb95209a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789265259.243405:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1789265259.243416:0:5840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 305048340598ns, next at 306048338398ns, rc = 0 00010000:00010000:1.0:1789265259.243474:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596800/0x27274ba5bb9520a1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265259.243485:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596800/0x27274ba5bb9520a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265259.243493:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596800/0x27274ba5bb9520a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265259.243511:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596800/0x27274ba5bb9520a1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265259.243517:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596800/0x27274ba5bb9520a1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265259.243523:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596800/0x27274ba5bb9520a1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265259.243536:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789265259.243557:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb95209a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265259.243563:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb95209a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265259.243569:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb95209a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265259.243575:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b597800 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789265259.243579:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb95209a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265259.243585:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb95209a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265259.243595:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8a101cdf4300) 00010000:00010000:1.0:1789265259.243598:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789265259.243602:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb95209a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265259.243619:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb95209a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265259.243636:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb95208c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265259.243641:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb95208c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265259.243647:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb95208c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265259.243651:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b597200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789265259.243655:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb95208c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265259.243660:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb95208c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265259.243668:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8a101cdf4400) 00010000:00010000:1.0:1789265259.243670:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265259.243673:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb95208c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265259.243679:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb95208c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789265259.243687:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000acdbfb14 reply state 000000004adcd7a8 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597000/0x27274ba5bb952093 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265259.243695:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789265259.243782:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1010f82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+16:9663:x1876180397477504:12345-192.168.203.37@tcp:36:rm.0 Request processed in 1568us (1760us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1789265259.243790:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 30 00010000:00010000:0.0:1789265259.245628:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265259.245641:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596800/0x27274ba5bb9520a1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265259.245651:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b596800 already unused, calling callback (ffffffffc1581350) 00010000:00010000:0.0:1789265259.245655:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596800/0x27274ba5bb9520a1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265259.245682:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596800/0x27274ba5bb9520a1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265259.245707:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8a101cdf4300) 00010000:00010000:0.0:1789265259.245710:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789265259.245715:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596800/0x27274ba5bb9520a1 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265259.245720:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596800/0x27274ba5bb9520a1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265259.245743:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265259.245745:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265259.245747:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265259.251351:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597000/0x27274ba5bb952093 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265259.251366:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597000/0x27274ba5bb952093 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265259.251391:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597000/0x27274ba5bb952093 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265259.251407:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b597000 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789265259.251412:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597000/0x27274ba5bb952093 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265259.251420:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597000/0x27274ba5bb952093 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265259.251436:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x94fd8476 (ffff8a101cdf4c00) 00010000:00010000:3.0:1789265259.251439:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265259.251443:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597000/0x27274ba5bb952093 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265259.251449:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597000/0x27274ba5bb952093 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265259.260813:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265259.260894:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397477760 00000100:00100000:3.0:1789265259.260905:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397477760 00000100:00100000:3.0:1789265259.260965:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 5 00000100:00100000:3.0:1789265259.260975:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1010f81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+15:9663:x1876180397477760:12345-192.168.203.37@tcp:35:rm.0 00000100:00100000:3.0:1789265259.261546:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1010f81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+16:9663:x1876180397477760:12345-192.168.203.37@tcp:35:rm.0 Request processed in 570us (740us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1789265259.261555:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 5 00000100:00100000:0.0:1789265259.265484:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265259.265586:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397478016 00000100:00100000:2.0:1789265259.265596:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397478016 00000100:00100000:2.0:1789265259.265657:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 31 00000100:00100000:2.0:1789265259.265667:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1010f80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+16:9663:x1876180397478016:12345-192.168.203.37@tcp:36:rm.0 00010000:00010000:2.0:1789265259.265753:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789265259.265786:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9400/0x27274ba5bb952062 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efdab expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265259.265808:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb952000 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efd88 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265259.265819:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8a101cdf4400) 00010000:00010000:2.0:1789265259.265845:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6400/0x27274ba5bb951fc1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efd7a expref: 14 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265259.265855:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1012931800) 00010000:00010000:2.0:1789265259.265862:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789265259.265884:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb9520a8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265259.265897:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb9520a8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265259.265907:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb9520a8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265259.265931:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb9520af lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265259.265939:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb9520af lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265259.265955:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb9520af lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265259.266586:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb9520b6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265259.266597:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb9520b6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265259.266604:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb9520b6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265259.267941:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789265259.268381:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb9520b6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265259.268390:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb9520b6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265259.268406:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb9520b6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265259.268412:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad6200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789265259.268417:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb9520b6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265259.268438:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb9520b6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265259.268452:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8a1012931c00) 00010000:00010000:2.0:1789265259.268455:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789265259.268459:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb9520b6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265259.268465:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb9520b6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265259.268489:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb9520a8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265259.268495:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb9520a8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265259.268501:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb9520a8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265259.268506:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad7400 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789265259.268508:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb9520a8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265259.268515:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb9520a8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265259.268522:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1012931300) 00010000:00010000:2.0:1789265259.268524:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265259.268527:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb9520a8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265259.268542:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb9520a8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789265259.268556:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006bd1f099 reply state 00000000ffc601de transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb9520af lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265259.268564:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789265259.268659:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1010f80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+15:9663:x1876180397478016:12345-192.168.203.37@tcp:36:rm.0 Request processed in 2989us (3180us total) trans 4294967308 rc 0/0 00010000:00010000:3.0:1789265259.272808:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb9520af lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265259.272827:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb9520af lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265259.272854:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb9520af lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265259.272860:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad6c00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789265259.272865:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb9520af lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265259.272873:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb9520af lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265259.272888:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8a1012931900) 00010000:00010000:3.0:1789265259.272891:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265259.272895:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb9520af lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265259.272901:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb9520af lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265259.273201:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 31 00000100:00100000:3.0:1789265259.316768:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c07a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414285312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789265259.316848:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265259.317032:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414285312 00000100:00100000:2.0:1789265259.317040:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414285312 00000100:00100000:2.0:1789265259.317137:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789265259.317146:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c0d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414285312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789265259.317182:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789265259.317232:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c0d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414285312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265259.317240:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1789265259.317254:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a103c07a680 x1876180414285312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265275 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265259.317275:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c07a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414285312:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789265259.317298:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789265259.826280:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265260.338626:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c07bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876180414285568:0@lo:400:kworker.0 00000100:00100000:1.0:1789265260.338637:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c078000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414285824:0@lo:400:kworker.0 00000100:00100000:0.0:1789265260.338853:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c07b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:871daf34-1206-40e7-bd71-78303abe4d37:3316:1876180414285440:0@lo:400:kworker.0 00000100:00100000:2.0:1789265260.339374:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265260.339434:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c07a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414286080:0@lo:400:kworker.0 00000100:00100000:2.0:1789265260.339466:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265260.339506:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789265260.339514:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c07aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1876180414285696:0@lo:400:kworker.0 00000100:00100000:2.0:1789265260.339542:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265260.339589:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414286080 00000100:00100000:2.0:1789265260.339602:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414286080 00000100:00100000:2.0:1789265260.339673:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789265260.339684:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102e766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1876180414286080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265260.340139:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102e766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1876180414286080:12345-0@lo:400:kworker.0 Request processed in 455us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265260.340149:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789265260.340178:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414285568 00000100:00100000:2.0:1789265260.340418:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414285568 00000100:00100000:2.0:1789265260.340459:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414285696 00000100:00100000:2.0:1789265260.340463:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414285696 00000100:00100000:2.0:1789265260.340488:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789265260.340496:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102e767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876180414285568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265260.340794:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265260.340854:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789265260.340863:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102e764380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876180414285696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265260.340900:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102e764380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876180414285696:12345-0@lo:400:kworker.0 Request processed in 39us (1357us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265260.340919:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789265260.340943:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414285824 00000100:00100000:1.0:1789265260.340947:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414285824 00000100:00100000:2.0:1789265260.340949:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102e767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876180414285568:12345-0@lo:400:kworker.0 Request processed in 452us (1574us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265260.340958:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789265260.340979:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1789265260.340984:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265260.340989:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1016d45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414285824:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789265260.340991:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789265260.341035:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1016d45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414285824:12345-0@lo:400:kworker.0 Request processed in 50us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265260.341041:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c07aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1876180414285696:0@lo:400:kworker.0 00000100:00100000:1.0:1789265260.341046:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789265260.341060:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c07bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876180414285568:0@lo:400:kworker.0 00010000:00080000:1.0:1789265260.341099:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a103c078000 x1876180414285824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265260.341110:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c078000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414285824:0@lo:400:kworker.0 00010000:00080000:2.0:1789265260.341593:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a103c07a680 x1876180414286080/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265260.341605:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c07a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414286080:0@lo:400:kworker.0 00000100:00100000:0.0:1789265260.342442:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265260.342493:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c079f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1876180414285952:0@lo:400:kworker.0 00000100:00100000:0.0:1789265260.342529:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265260.342774:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414285952 00000100:00100000:1.0:1789265260.342782:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414285952 00000100:00100000:1.0:1789265260.342852:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789265260.342860:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1010f82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876180414285952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265260.342918:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1010f82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876180414285952:12345-0@lo:400:kworker.0 Request processed in 58us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265260.342925:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789265260.343514:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c079f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1876180414285952:0@lo:400:kworker.0 00000100:00080000:0.0:1789265260.343537:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265260.343606:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414285440 00000100:00100000:2.0:1789265260.343611:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414285440 00000100:00100000:2.0:1789265260.343647:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1789265260.343654:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+19:3316:x1876180414285440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265260.343722:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+19:3316:x1876180414285440:12345-0@lo:400:kworker.0 Request processed in 69us (1281us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265260.343728:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1789265260.343943:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c07b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:871daf34-1206-40e7-bd71-78303abe4d37:3316:1876180414285440:0@lo:400:kworker.0 00000100:00100000:0.0:1789265260.784597:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265260.784638:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265260.784705:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265260.784729:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265260.784769:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397478272 00000100:00100000:0.0:1789265260.784780:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397478272 00000100:00100000:0.0:1789265260.784846:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397478528 00000100:00100000:0.0:1789265260.784849:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397478528 00000100:00100000:0.0:1789265260.784872:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 89 00000100:00100000:0.0:1789265260.784882:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1010f80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+14:2348:x1876180397478272:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789265260.784967:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1010f80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+14:2348:x1876180397478272:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 86us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265260.784975:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 89 00000100:00100000:0.0:1789265260.785004:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 90 00000100:00100000:0.0:1789265260.785012:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1010f81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+5:2348:x1876180397478528:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789265260.785040:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1010f81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+5:2348:x1876180397478528:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 29us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265260.785045:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 90 00000100:00080000:0.0:1789265260.785242:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265260.785418:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397478144 00000100:00100000:1.0:1789265260.785423:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397478144 00000100:00100000:1.0:1789265260.785468:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 244 00000100:00100000:1.0:1789265260.785475:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+13:2348:x1876180397478144:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789265260.785507:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+13:2348:x1876180397478144:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 33us (918us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265260.785513:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 244 00000100:00100000:3.0:1789265260.785666:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397478400 00000100:00100000:3.0:1789265260.785670:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397478400 00000100:00100000:3.0:1789265260.785724:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 53 00000100:00100000:3.0:1789265260.785731:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1010f80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+5:2348:x1876180397478400:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789265260.785759:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1010f80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+5:2348:x1876180397478400:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 29us (1120us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265260.785765:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 53 00010000:00010000:3.0:1789265260.850369:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789265260.850555:0:8082:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 306655478826ns, next at 307655476885ns, rc = 0 00000100:00100000:3.0:1789265260.850608:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789265260.850630:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102e764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414286208:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789265260.850714:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265260.850905:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414286208 00000100:00100000:2.0:1789265260.850915:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414286208 00000100:00100000:2.0:1789265260.850969:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789265260.850979:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c0d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876180414286208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789265260.851026:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789265260.851102:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c0d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876180414286208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265260.851109:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1789265260.851190:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a102e764000 x1876180414286208/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265276 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265260.851209:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102e764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414286208:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789265261.877733:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265262.899179:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789265263.304556:0:11604:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:0.0:1789265263.922409:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789265264.313413:0:11652:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff7d751c60 20000000:00000080:0.0:1789265264.313431:0:11652:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8a1008753000 uarg=0000000000000000 20000000:01000000:0.0:1789265264.314211:0:11652:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1789265264.314219:0:11652:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1789265264.314223:0:11652:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1789265264.318668:0:11653:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1789265264.318853:0:11652:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1789265264.326523:0:11652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1789265264.326587:0:11652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1789265264.326645:0:11652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1789265264.326665:0:11652:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789265264.326686:0:11652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a103fae8400/0x27274ba5bb9520bd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265264.326704:0:11652:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1017262600/0x27274ba5bb951f5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efd65 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265264.326712:0:11652:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a101b597c00/0x27274ba5bb951f66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efd6c expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265264.326721:0:11652:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a101b596400/0x27274ba5bb951f74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb951f6d expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265264.326727:0:11652:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1042044000/0x27274ba5bb951f82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb951f7b expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265264.326733:0:11652:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1042044200/0x27274ba5bb951f90 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb951f89 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265264.326751:0:11652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a103fae8400/0x27274ba5bb9520bd lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265264.327123:0:11652:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1042044200/0x27274ba5bb951f90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27274ba5bb951f89 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265264.327143:0:11652:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a1042044200/0x27274ba5bb951f90 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27274ba5bb951f89 expref: 18 pid: 5835 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265264.327159:0:11652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103bb07480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11652:1876180414286336:0@lo:104: 00000100:00100000:3.0:1789265264.327241:0:11652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789265264.327297:0:11652:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1042044000/0x27274ba5bb951f82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27274ba5bb951f7b expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265264.327306:0:11652:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a1042044000/0x27274ba5bb951f82 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27274ba5bb951f7b expref: 18 pid: 5833 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265264.327315:0:11652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103bb04380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11652:1876180414286464:0@lo:104: 00000100:00100000:3.0:1789265264.327339:0:11652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789265264.327377:0:11652:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a101b596400/0x27274ba5bb951f74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27274ba5bb951f6d expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265264.327385:0:11652:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a101b596400/0x27274ba5bb951f74 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27274ba5bb951f6d expref: 18 pid: 5833 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265264.327393:0:11652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103bb05500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11652:1876180414286592:0@lo:104: 00000100:00100000:3.0:1789265264.327417:0:11652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789265264.327438:0:11652:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a101b597c00/0x27274ba5bb951f66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efd6c expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265264.327462:0:11652:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a101b597c00/0x27274ba5bb951f66 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efd6c expref: 12 pid: 5833 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265264.327472:0:11652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103bb04e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11652:1876180414286720:192.168.203.37@tcp:104: 00010000:00010000:3.0:1789265264.327529:0:11652:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1017262600/0x27274ba5bb951f5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efd65 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265264.327537:0:11652:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a1017262600/0x27274ba5bb951f5f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efd65 expref: 12 pid: 5835 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265264.327546:0:11652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103bb06680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11652:1876180414286848:192.168.203.37@tcp:104: 00000100:00100000:3.0:1789265264.327568:0:11652:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1032c89d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789265264.327644:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789265264.327660:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414286336 00000100:00100000:0.0:1789265264.327672:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414286336 00000100:00100000:0.0:1789265264.327708:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414286464 00000100:00100000:0.0:1789265264.327711:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414286464 00000100:00100000:0.0:1789265264.327720:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414286592 00000100:00100000:0.0:1789265264.327722:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414286592 00000100:00100000:0.0:1789265264.327734:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789265264.327741:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bb05c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:871daf34-1206-40e7-bd71-78303abe4d37+5:11652:x1876180414286336:12345-0@lo:104: 00010000:00010000:0.0:1789265264.327753:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff8a103fad6e00/0x27274ba5bb951f89 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x27274ba5bb951f90 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265264.327821:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789265264.327827:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bb05c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:871daf34-1206-40e7-bd71-78303abe4d37+5:11652:x1876180414286336:12345-0@lo:104: Request processed in 86us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265264.327833:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789265264.327849:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789265264.327855:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bb06a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:871daf34-1206-40e7-bd71-78303abe4d37+4:11652:x1876180414286464:12345-0@lo:104: 00010000:00010000:0.0:1789265264.327862:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff8a103fad7000/0x27274ba5bb951f7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x27274ba5bb951f82 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265264.327894:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789265264.327899:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bb06a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:871daf34-1206-40e7-bd71-78303abe4d37+4:11652:x1876180414286464:12345-0@lo:104: Request processed in 45us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265264.327905:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789265264.327916:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789265264.327921:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1002e20050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:871daf34-1206-40e7-bd71-78303abe4d37+3:11652:x1876180414286592:12345-0@lo:104: 00010000:00010000:0.0:1789265264.327928:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff8a1042045c00/0x27274ba5bb951f6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x27274ba5bb951f74 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265264.327967:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789265264.327977:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1002e20050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:871daf34-1206-40e7-bd71-78303abe4d37+3:11652:x1876180414286592:12345-0@lo:104: Request processed in 56us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265264.327983:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1789265264.328144:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789265264.328151:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff8a103fad6e00/0x27274ba5bb951f89 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x27274ba5bb951f90 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265264.328159:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad6e00 already unused, calling callback (ffffffffc1ba2c20) 10000000:00010000:0.0:1789265264.328163:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff8a103fad6e00/0x27274ba5bb951f89 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x27274ba5bb951f90 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265264.328172:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff8a103fad6e00/0x27274ba5bb951f89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x27274ba5bb951f90 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789265264.328179:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff8a103fad6e00/0x27274ba5bb951f89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x27274ba5bb951f90 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265264.328184:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789265264.328213:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff8a103fad6e00/0x27274ba5bb951f89 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951f90 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265264.328219:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789265264.328240:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff8a103fad6e00/0x27274ba5bb951f89 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951f90 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265264.328246:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff8a103fad6e00/0x27274ba5bb951f89 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951f90 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265264.328258:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789265264.328261:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff8a103fad7000/0x27274ba5bb951f7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x27274ba5bb951f82 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265264.328279:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad7000 already unused, calling callback (ffffffffc1ba2c20) 10000000:00010000:0.0:1789265264.328282:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff8a103fad7000/0x27274ba5bb951f7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x27274ba5bb951f82 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265264.328288:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff8a103fad7000/0x27274ba5bb951f7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x27274ba5bb951f82 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789265264.328294:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff8a103fad7000/0x27274ba5bb951f7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x27274ba5bb951f82 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265264.328299:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789265264.328312:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff8a103fad7000/0x27274ba5bb951f7b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951f82 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265264.328318:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789265264.328324:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff8a103fad7000/0x27274ba5bb951f7b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951f82 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265264.328329:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff8a103fad7000/0x27274ba5bb951f7b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951f82 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265264.328337:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265264.328341:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff8a1042045c00/0x27274ba5bb951f6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27274ba5bb951f74 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265264.328347:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1042045c00 already unused, calling callback (ffffffffc1ba2c20) 10000000:00010000:0.0:1789265264.328349:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff8a1042045c00/0x27274ba5bb951f6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x27274ba5bb951f74 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265264.328381:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff8a1042045c00/0x27274ba5bb951f6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x27274ba5bb951f74 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789265264.328387:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff8a1042045c00/0x27274ba5bb951f6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x27274ba5bb951f74 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265264.328392:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789265264.328405:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff8a1042045c00/0x27274ba5bb951f6d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951f74 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265264.328411:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789265264.328427:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff8a1042045c00/0x27274ba5bb951f6d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951f74 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265264.328434:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff8a1042045c00/0x27274ba5bb951f6d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb951f74 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265264.328448:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265264.328450:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265264.328451:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265264.328458:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265264.328468:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1010f81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:871daf34-1206-40e7-bd71-78303abe4d37:3317:1876180414287232:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789265264.328501:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265264.328974:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1010f80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:871daf34-1206-40e7-bd71-78303abe4d37:3315:1876180414286976:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789265264.329006:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265264.329041:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789265264.329047:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1010f83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:871daf34-1206-40e7-bd71-78303abe4d37:3315:1876180414287104:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789265264.329069:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265264.329119:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414287232 00000100:00100000:2.0:1789265264.329125:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414287232 00010000:00010000:2.0:1789265264.329151:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a101b596400/0x27274ba5bb951f74 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27274ba5bb951f6d expref: 19 pid: 5833 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265264.329174:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414286976 00000100:00100000:2.0:1789265264.329177:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414286976 00010000:00010000:2.0:1789265264.329188:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1042044200/0x27274ba5bb951f90 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27274ba5bb951f89 expref: 20 pid: 5835 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265264.329198:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414287104 00000100:00100000:2.0:1789265264.329208:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414287104 00010000:00010000:2.0:1789265264.329221:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1042044000/0x27274ba5bb951f82 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27274ba5bb951f7b expref: 21 pid: 5833 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265264.329421:0:11652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103bb07480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11652:1876180414286336:0@lo:104: 00000100:00100000:3.0:1789265264.329432:0:11652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103bb04380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11652:1876180414286464:0@lo:104: 00000100:00100000:3.0:1789265264.329440:0:11652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103bb05500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11652:1876180414286592:0@lo:104: 00000100:00100000:0.0:1789265264.329505:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789265264.329516:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1010f81880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:871daf34-1206-40e7-bd71-78303abe4d37+21:3317:x1876180414287232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789265264.329529:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265264.329535:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a101b596400/0x27274ba5bb951f74 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27274ba5bb951f6d expref: 21 pid: 5833 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265264.329556:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a101b596400/0x27274ba5bb951f74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27274ba5bb951f6d expref: 21 pid: 5833 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265264.329572:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a101b596400/0x27274ba5bb951f74 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27274ba5bb951f6d expref: 21 pid: 5833 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265264.329586:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265264.329626:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1010f81880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:871daf34-1206-40e7-bd71-78303abe4d37+20:3317:x1876180414287232:12345-0@lo:103:ldlm_bl.0 Request processed in 113us (1124us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265264.329632:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789265264.329649:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789265264.329655:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102e764a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:871daf34-1206-40e7-bd71-78303abe4d37+19:3315:x1876180414286976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789265264.329662:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265264.329666:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1042044200/0x27274ba5bb951f90 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27274ba5bb951f89 expref: 19 pid: 5835 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265264.329678:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1042044200/0x27274ba5bb951f90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27274ba5bb951f89 expref: 19 pid: 5835 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265264.329688:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1042044200/0x27274ba5bb951f90 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27274ba5bb951f89 expref: 19 pid: 5835 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265264.329699:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265264.329725:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102e764a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:871daf34-1206-40e7-bd71-78303abe4d37+18:3315:x1876180414286976:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265264.329731:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789265264.329744:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789265264.329750:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10118e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:871daf34-1206-40e7-bd71-78303abe4d37+17:3315:x1876180414287104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789265264.329764:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265264.329769:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1042044000/0x27274ba5bb951f82 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27274ba5bb951f7b expref: 17 pid: 5833 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265264.329779:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1042044000/0x27274ba5bb951f82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27274ba5bb951f7b expref: 17 pid: 5833 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265264.329789:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1042044000/0x27274ba5bb951f82 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27274ba5bb951f7b expref: 17 pid: 5833 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265264.329810:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265264.329832:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10118e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:871daf34-1206-40e7-bd71-78303abe4d37+16:3315:x1876180414287104:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265264.329839:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789265264.329913:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1010f83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:871daf34-1206-40e7-bd71-78303abe4d37:3315:1876180414287104:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789265264.329920:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1010f80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:871daf34-1206-40e7-bd71-78303abe4d37:3315:1876180414286976:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789265264.330032:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1010f81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:871daf34-1206-40e7-bd71-78303abe4d37:3317:1876180414287232:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789265264.331678:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265264.331713:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265264.331917:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397478656 00000100:00100000:2.0:1789265264.331926:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397478656 00010000:00010000:2.0:1789265264.331960:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1017262600/0x27274ba5bb951f5f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efd65 expref: 13 pid: 5835 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265264.331995:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397478784 00000100:00100000:2.0:1789265264.331999:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397478784 00010000:00010000:2.0:1789265264.332011:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a101b597c00/0x27274ba5bb951f66 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efd6c expref: 14 pid: 5833 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265264.332030:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 33 00000100:00100000:2.0:1789265264.332038:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1010f81880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+14:2351:x1876180397478656:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265264.332052:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265264.332057:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1017262600/0x27274ba5bb951f5f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efd65 expref: 14 pid: 5835 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265264.332066:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1017262600/0x27274ba5bb951f5f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efd65 expref: 14 pid: 5835 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265264.332110:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265264.332163:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1010f81880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+14:2351:x1876180397478656:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 121us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265264.332171:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 33 00000100:00100000:2.0:1789265264.332200:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 34 00000100:00100000:2.0:1789265264.332206:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1010f83b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+13:2350:x1876180397478784:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265264.332215:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265264.332219:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a101b597c00/0x27274ba5bb951f66 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efd6c expref: 13 pid: 5833 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265264.332230:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a101b597c00/0x27274ba5bb951f66 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efd6c expref: 13 pid: 5833 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265264.332242:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a103fae8400/0x27274ba5bb9520bd lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265264.332251:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a103fae8400/0x27274ba5bb9520bd lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265264.332264:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a103fae8400/0x27274ba5bb9520bd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265264.332272:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a103fae8400/0x27274ba5bb9520bd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265264.332278:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a103fae8400/0x27274ba5bb9520bd lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265264.332285:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a103fae8400/0x27274ba5bb9520bd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265264.332292:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fae8400 already unused, calling callback (ffffffffc1581350) 00010000:00010000:2.0:1789265264.332295:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a103fae8400/0x27274ba5bb9520bd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265264.332313:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a103fae8400/0x27274ba5bb9520bd lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265264.332322:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a103fae8400/0x27274ba5bb9520bd lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265264.332332:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265264.332352:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1010f83b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+13:2350:x1876180397478784:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 146us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265264.332359:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 34 00010000:00010000:3.0:1789265264.343992:0:11652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a101b597c00/0x27274ba5bb951f66 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efd6c expref: 12 pid: 5833 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265264.344020:0:11652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103bb04e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11652:1876180414286720:192.168.203.37@tcp:104: 00010000:00010000:3.0:1789265264.344115:0:11652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1017262600/0x27274ba5bb951f5f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efd65 expref: 11 pid: 5835 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265264.344126:0:11652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103bb06680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11652:1876180414286848:192.168.203.37@tcp:104: 00010000:00010000:3.0:1789265264.344163:0:11652:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a103fae8400/0x27274ba5bb9520bd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265264.344189:0:11652:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a103fae8400/0x27274ba5bb9520bd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265264.344196:0:11652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a103fae8400/0x27274ba5bb9520bd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265264.344201:0:11652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a103fae8400/0x27274ba5bb9520bd lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265264.434354:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1016d46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414287360:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789265264.434441:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265264.434583:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414287360 00000100:00100000:1.0:1789265264.434591:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414287360 00000100:00100000:1.0:1789265264.434653:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789265264.434661:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bb06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876180414287360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789265264.434693:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789265264.434738:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bb06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876180414287360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265264.434745:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:3.0:1789265264.434792:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789265264.434820:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1016d46d80 x1876180414287360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265280 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265264.434837:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1016d46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414287360:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1789265264.464946:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967304 is committed 00000001:00080000:2.0:1789265264.464963:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967306 is committed 00000004:00080000:2.0:1789265264.464967:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000004:00080000:2.0:1789265264.464987:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:2.0:1789265264.464993:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:3.0:1789265264.465195:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789265264.465214:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103bb04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414287488:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789265264.465281:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265264.465339:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414287488 00000100:00100000:3.0:1789265264.465346:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414287488 00000100:00100000:3.0:1789265264.465406:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789265264.465414:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bb05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414287488:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789265264.465438:0:6682:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:3.0:1789265264.465468:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6aa6056b, atime: 0x6aa6056b, ctime: 0x6aa6056b, blocks: 0x1 00010000:00010000:3.0:1789265264.465476:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037813be8/0x27274ba5bb9520c4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265264.465504:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=310s v=(0 0) 00010000:00010000:3.0:1789265264.465508:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265264.465514:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037813be8/0x27274ba5bb9520c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265264.465531:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037813be8/0x27274ba5bb9520c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265264.465540:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037813be8/0x27274ba5bb9520c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265264.465547:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000037813be8/0x27274ba5bb9520c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265264.465570:0:6682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:2.0:1789265264.466123:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789265264.466382:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bb05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3316:x1876180414287488:12345-0@lo:6:osp-syn-1-0.0 Request processed in 967us (1099us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1789265264.466391:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:2.0:1789265264.466560:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a103bb04e00/2, rc 0, transno 4294967300 00000100:00100000:2.0:1789265264.466566:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103bb04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414287488:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1789265264.466793:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265264.466802:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000037813be8/0x27274ba5bb9520c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265264.466814:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fae8400 already unused, calling callback (ffffffffc1581350) 00010000:00010000:0.0:1789265264.466818:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000037813be8/0x27274ba5bb9520c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265264.466828:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000037813be8/0x27274ba5bb9520c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265264.466851:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000037813be8/0x27274ba5bb9520c4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265264.466865:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037813be8/0x27274ba5bb9520c4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265264.466886:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265264.466887:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265264.466889:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265264.946716:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265265.458510:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1010f82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876180414287744:0@lo:400:kworker.0 00000100:00100000:1.0:1789265265.458581:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265265.458823:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1010f83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414288000:0@lo:400:kworker.0 00000100:00100000:3.0:1789265265.458860:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265265.458870:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414287744 00000100:00100000:0.0:1789265265.458878:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414287744 00000100:00100000:3.0:1789265265.458890:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1010f82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1876180414287872:0@lo:400:kworker.0 00000100:00100000:3.0:1789265265.458917:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265265.458972:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1010f80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414288256:0@lo:400:kworker.0 00000100:00100000:1.0:1789265265.459000:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265265.459054:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414288000 00000100:00100000:1.0:1789265265.459058:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414288000 00000100:00100000:1.0:1789265265.459104:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414288256 00000100:00100000:1.0:1789265265.459107:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414288256 00000100:00100000:1.0:1789265265.459127:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789265265.459136:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bb04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414288000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265265.459181:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bb04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414288000:12345-0@lo:400:kworker.0 Request processed in 46us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265265.459188:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789265265.459204:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789265265.459210:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1016d44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3317:x1876180414288256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265265.459240:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1016d44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3317:x1876180414288256:12345-0@lo:400:kworker.0 Request processed in 30us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265265.459245:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:1.0:1789265265.459290:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1010f83480 x1876180414288000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265281 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265265.459304:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1010f83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414288000:0@lo:400:kworker.0 00000100:00100000:1.0:1789265265.459321:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789265265.459327:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1010f83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:871daf34-1206-40e7-bd71-78303abe4d37:3315:1876180414287616:0@lo:400:kworker.0 00000100:00100000:1.0:1789265265.459366:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265265.459388:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1010f81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1876180414288128:0@lo:400:kworker.0 00000100:00100000:1.0:1789265265.459422:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1010f80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414288256:0@lo:400:kworker.0 00000100:00100000:2.0:1789265265.459645:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414287616 00000100:00100000:2.0:1789265265.459650:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414287616 00000100:00100000:2.0:1789265265.459679:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1789265265.459686:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+16:3315:x1876180414287616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265265.459725:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+16:3315:x1876180414287616:12345-0@lo:400:kworker.0 Request processed in 40us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265265.459732:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1789265265.466603:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414287872 00000100:00100000:0.0:1789265265.466631:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414287872 00000100:00100000:0.0:1789265265.466716:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789265265.466728:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1016d46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876180414287744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265265.466971:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1016d46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876180414287744:12345-0@lo:400:kworker.0 Request processed in 244us (8388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265265.466978:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789265265.466997:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789265265.467005:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bb07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1876180414287872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265265.467039:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bb07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1876180414287872:12345-0@lo:400:kworker.0 Request processed in 36us (8121us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265265.467045:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:0.0:1789265265.467209:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265265.467249:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1010f82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876180414287744:0@lo:400:kworker.0 00000100:00100000:0.0:1789265265.467284:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1010f82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1876180414287872:0@lo:400:kworker.0 00000100:00100000:0.0:1789265265.467323:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265265.467383:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1010f83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:871daf34-1206-40e7-bd71-78303abe4d37:3315:1876180414287616:0@lo:400:kworker.0 00000100:00100000:0.0:1789265265.467401:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414288128 00000100:00100000:0.0:1789265265.467406:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414288128 00000100:00100000:0.0:1789265265.467434:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789265265.467440:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1010f82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876180414288128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265265.467475:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1010f82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876180414288128:12345-0@lo:400:kworker.0 Request processed in 34us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265265.467481:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:0.0:1789265265.467494:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265265.469188:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1010f81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1876180414288128:0@lo:400:kworker.0 10000000:01000000:2.0:1789265265.778186:0:5837:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789265265.778194:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a103bd8f000 from 7 10000000:01000000:2.0:1789265265.778224:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789265265.778272:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a103fad6800/0x27274ba5bb9520cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265265.778283:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff8a103fad6800/0x27274ba5bb9520cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265265.778295:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff8a103fad6800/0x27274ba5bb9520cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265265.778320:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102e765180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414288384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789265265.778406:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265265.778462:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103bc97cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265265.778605:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414288384 00000100:00100000:0.0:1789265265.778614:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414288384 00000100:00100000:0.0:1789265265.778675:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1789265265.778685:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+16:5837:x1876180414288384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789265265.778698:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265265.778714:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1017263000/0x27274ba5bb9520d2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27274ba5bb9520cb expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265265.778738:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1017263000/0x27274ba5bb9520d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27274ba5bb9520cb expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265265.778748:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1017263000/0x27274ba5bb9520d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb9520cb expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265265.778757:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1017263000, rc 0) 00000100:00100000:0.0:1789265265.778817:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+17:5837:x1876180414288384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265265.778825:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1789265265.779064:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102e765180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414288384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265265.779106:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff8a103fad6800/0x27274ba5bb9520cb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb9520d2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265265.779133:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff8a103fad6800/0x27274ba5bb9520cb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27274ba5bb9520d2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265265.779197:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103bb04700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414288512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265265.779979:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265265.780020:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1032c89540 going to sleep for 11 seconds 00000100:00100000:2.0:1789265265.780108:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414288512 00000100:00100000:2.0:1789265265.780122:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414288512 00000100:00100000:2.0:1789265265.780167:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1789265265.780176:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+17:5837:x1876180414288512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265265.780711:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+17:5837:x1876180414288512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 536us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265265.780719:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1789265265.781031:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103bb04700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414288512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265265.781090:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103bb04700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414288640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789265265.781139:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265265.781165:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1032c89540 going to sleep for 11 seconds 00000100:00100000:2.0:1789265265.781434:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414288640 00000100:00100000:2.0:1789265265.781440:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414288640 00000100:00100000:2.0:1789265265.781473:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1789265265.781481:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10119dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+17:5837:x1876180414288640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265265.781638:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10119dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+17:5837:x1876180414288640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 157us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265265.781645:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1789265265.781749:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103bb04700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414288640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789265265.782568:0:11666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103bb04700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:11666:1876180414288768:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265265.782626:0:11666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265265.782659:0:11666:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1032c89b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789265265.782713:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414288768 00000100:00100000:2.0:1789265265.782725:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414288768 00000100:00100000:2.0:1789265265.782762:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1789265265.782770:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10119ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+17:11666:x1876180414288768:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265265.784010:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10119ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+17:11666:x1876180414288768:12345-0@lo:502:llog_process_th.0 Request processed in 1236us (1378us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265265.784020:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1789265265.784140:0:11666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103bb04700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:11666:1876180414288768:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789265265.784171:0:11666:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265265.784180:0:11666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265265.784183:0:11666:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789265265.784191:0:11666:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a103bd8f000 00000020:00000080:3.0:1789265265.784195:0:11666:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789265265.784288:0:11666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103bb04700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:11666:1876180414288896:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265265.784329:0:11666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265265.784378:0:11666:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1032c89b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789265265.784556:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414288896 00000100:00100000:0.0:1789265265.784562:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414288896 00000100:00100000:0.0:1789265265.784608:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1789265265.784617:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10119dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+17:11666:x1876180414288896:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789265265.784786:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10119dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+17:11666:x1876180414288896:12345-0@lo:502:llog_process_th.0 Request processed in 170us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265265.784793:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1789265265.785318:0:11666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103bb04700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:11666:1876180414288896:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789265265.785366:0:11666:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265265.785372:0:11666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265265.785374:0:11666:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789265265.785379:0:11666:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1789265265.785597:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1789265265.785616:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789265265.785627:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a103fad6800/0x27274ba5bb9520cb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb9520d2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265265.785639:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff8a103fad6800/0x27274ba5bb9520cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb9520d2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265265.785650:0:5837:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789265265.785653:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a103c151000 from 7 10000000:01000000:0.0:1789265265.785656:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789265265.785685:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a1017262400/0x27274ba5bb9520d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265265.785692:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff8a1017262400/0x27274ba5bb9520d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265265.785701:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff8a1017262400/0x27274ba5bb9520d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265265.785718:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1010f81180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414289024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789265265.785757:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265265.785801:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a0f0112ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1789265265.785872:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414289024 00000100:00100000:1.0:1789265265.785878:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414289024 00000100:00100000:1.0:1789265265.785915:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1789265265.785924:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10119dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+17:5837:x1876180414289024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789265265.785940:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265265.785951:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a101b596800/0x27274ba5bb9520e0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x27274ba5bb9520d9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265265.785975:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a101b596800/0x27274ba5bb9520e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27274ba5bb9520d9 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265265.785985:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a101b596800/0x27274ba5bb9520e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb9520d9 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265265.785993:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a101b596800, rc 0) 00000100:00100000:1.0:1789265265.786038:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10119dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+18:5837:x1876180414289024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265265.786044:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1789265265.786603:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1010f81180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414289024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265265.786618:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff8a1017262400/0x27274ba5bb9520d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb9520e0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265265.786626:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff8a1017262400/0x27274ba5bb9520d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x27274ba5bb9520e0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265265.786683:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103bb04700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414289152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265265.786715:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265265.786744:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1032c89b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789265265.786833:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414289152 00000100:00100000:1.0:1789265265.786838:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414289152 00000100:00100000:1.0:1789265265.786950:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1789265265.786958:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10119df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+18:5837:x1876180414289152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265265.788407:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10119df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+18:5837:x1876180414289152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1446us (1688us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265265.788418:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1789265265.789017:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103bb04700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414289152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265265.789067:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103bb04700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414289280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789265265.789140:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265265.789177:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1032c89b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789265265.792025:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414289280 00000100:00100000:1.0:1789265265.792039:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414289280 00000100:00100000:1.0:1789265265.792124:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1789265265.792136:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10119de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+18:5837:x1876180414289280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789265265.792552:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10119de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+18:5837:x1876180414289280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 418us (3411us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265265.792570:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1789265265.793257:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103bb04700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414289280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789265265.803561:0:11668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1010f83100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:11668:1876180414289408:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789265265.803641:0:11668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265265.803682:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414289408 00000100:00100000:0.0:1789265265.803689:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414289408 00000100:00100000:0.0:1789265265.803728:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1789265265.803736:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10119dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+18:11668:x1876180414289408:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789265265.803958:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10119dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+18:11668:x1876180414289408:12345-0@lo:502:llog_process_th.0 Request processed in 222us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265265.803966:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1789265265.804014:0:11668:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a0f0112ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1789265265.804035:0:11668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1010f83100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:11668:1876180414289408:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789265265.804066:0:11668:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789265265.804094:0:11668:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265265.804096:0:11668:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789265265.804103:0:11668:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a103c151000 00000020:00000080:0.0:1789265265.804106:0:11668:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789265265.804193:0:11668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1010f83100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:11668:1876180414289536:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789265265.804336:0:11668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265265.804481:0:11668:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103bb4f480 going to sleep for 11 seconds 00000100:00100000:2.0:1789265265.804584:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414289536 00000100:00100000:2.0:1789265265.804590:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414289536 00000100:00100000:2.0:1789265265.804627:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1789265265.804635:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10119dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+18:11668:x1876180414289536:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265265.804770:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10119dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+18:11668:x1876180414289536:12345-0@lo:502:llog_process_th.0 Request processed in 136us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265265.804777:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1789265265.805284:0:11668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1010f83100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:11668:1876180414289536:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789265265.805311:0:11668:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789265265.805318:0:11668:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265265.805320:0:11668:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789265265.805324:0:11668:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1789265265.805634:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1789265265.805653:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789265265.805663:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a1017262400/0x27274ba5bb9520d9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb9520e0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265265.805674:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff8a1017262400/0x27274ba5bb9520d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb9520e0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265265.805696:0:5837:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789265265.805699:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a10202ad000 from 7 10000000:01000000:3.0:1789265265.805702:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789265265.805730:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a103fae9e00/0x27274ba5bb9520e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265265.805738:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff8a103fae9e00/0x27274ba5bb9520e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265265.805748:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff8a103fae9e00/0x27274ba5bb9520e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265265.805764:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103bb04700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414289664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789265265.805803:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265265.805839:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1032c89540 going to sleep for 11 seconds 00000100:00100000:0.0:1789265265.807650:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414289664 00000100:00100000:0.0:1789265265.807662:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414289664 00000100:00100000:0.0:1789265265.807710:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1789265265.807720:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a100881c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+18:5837:x1876180414289664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789265265.807732:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265265.807748:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1017262e00/0x27274ba5bb9520ee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x27274ba5bb9520e7 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265265.807774:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1017262e00/0x27274ba5bb9520ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27274ba5bb9520e7 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265265.807787:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1017262e00/0x27274ba5bb9520ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb9520e7 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265265.807797:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1017262e00, rc 0) 00000100:00100000:0.0:1789265265.807871:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a100881c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+19:5837:x1876180414289664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (2067us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265265.807878:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1789265265.808229:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103bb04700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414289664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265265.808245:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff8a103fae9e00/0x27274ba5bb9520e7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb9520ee expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265265.808256:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff8a103fae9e00/0x27274ba5bb9520e7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x27274ba5bb9520ee expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265265.808321:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103bb04700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414289792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265265.808369:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265265.808399:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1032c89540 going to sleep for 11 seconds 00000100:00100000:0.0:1789265265.809226:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414289792 00000100:00100000:0.0:1789265265.809233:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414289792 00000100:00100000:0.0:1789265265.809272:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1789265265.809281:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a100881f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+19:5837:x1876180414289792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789265265.809571:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a100881f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+19:5837:x1876180414289792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 290us (1200us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265265.809579:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1789265265.809619:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103bb04700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414289792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789265265.809656:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1010f83100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414289920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789265265.809698:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265265.809720:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103bb4ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1789265265.809972:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414289920 00000100:00100000:2.0:1789265265.809979:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414289920 00000100:00100000:2.0:1789265265.810011:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1789265265.810019:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a100881d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+19:5837:x1876180414289920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265265.810198:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a100881d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+19:5837:x1876180414289920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 180us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265265.810205:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1789265265.810254:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1010f83100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:871daf34-1206-40e7-bd71-78303abe4d37:5837:1876180414289920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265265.811016:0:11670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102e765c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:11670:1876180414290048:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265265.811065:0:11670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265265.811107:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414290048 00000100:00100000:2.0:1789265265.811119:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414290048 00000100:00100000:2.0:1789265265.811144:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1789265265.811157:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a100881dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+19:11670:x1876180414290048:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265265.811517:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a100881dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+19:11670:x1876180414290048:12345-0@lo:502:llog_process_th.0 Request processed in 359us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265265.811524:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1789265265.811563:0:11670:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103bc97900 going to sleep for 11 seconds 00000100:00100000:2.0:1789265265.811579:0:11670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102e765c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:11670:1876180414290048:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789265265.811602:0:11670:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789265265.811611:0:11670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265265.811613:0:11670:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789265265.811620:0:11670:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a10202ad000 00000020:00000080:2.0:1789265265.811622:0:11670:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789265265.811685:0:11670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102e765c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:11670:1876180414290176:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265265.811717:0:11670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265265.811736:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414290176 00000100:00100000:2.0:1789265265.811742:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414290176 00000100:00100000:2.0:1789265265.811761:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1789265265.811766:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a100881fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+19:11670:x1876180414290176:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265265.812674:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a100881fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+19:11670:x1876180414290176:12345-0@lo:502:llog_process_th.0 Request processed in 902us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265265.812685:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1789265265.812723:0:11670:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103bc97900 going to sleep for 11 seconds 00000100:00100000:2.0:1789265265.812741:0:11670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102e765c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:871daf34-1206-40e7-bd71-78303abe4d37:11670:1876180414290176:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789265265.812765:0:11670:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265265.812772:0:11670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265265.812774:0:11670:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1789265265.812778:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1789265265.815002:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1789265265.815034:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789265265.815052:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a103fae9e00/0x27274ba5bb9520e7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb9520ee expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265265.815065:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff8a103fae9e00/0x27274ba5bb9520e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb9520ee expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789265265.822096:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789265265.908063:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265265.911261:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265265.911333:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265265.912550:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397478912 00000100:00100000:3.0:1789265265.912563:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397478912 00000100:00100000:3.0:1789265265.912673:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 261 00000100:00100000:3.0:1789265265.912684:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a100881cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1230cd-a81b-4bcc-a532-e24f5353fef4+11:2351:x1876180397478912:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789265265.912757:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a100881cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1230cd-a81b-4bcc-a532-e24f5353fef4+11:2351:x1876180397478912:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 76us (1506us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265265.912765:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 261 00000100:00100000:0.0:1789265265.915244:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397479040 00000100:00100000:0.0:1789265265.915258:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397479040 00000100:00100000:0.0:1789265265.915388:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397479296 00000100:00100000:0.0:1789265265.915392:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397479296 00000100:00080000:3.0:1789265265.915431:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265265.915456:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 94 00000100:00100000:2.0:1789265265.915477:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1016d44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+5:2350:x1876180397479040:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789265265.915512:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 95 00000100:00100000:0.0:1789265265.915519:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1016d47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+5:2350:x1876180397479296:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789265265.915549:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1016d47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+5:2350:x1876180397479296:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 31us (4216us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265265.915557:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 95 00000100:00100000:1.0:1789265265.915988:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265265.916022:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397479168 00000100:00100000:2.0:1789265265.916024:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1016d44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+5:2350:x1876180397479040:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 551us (7969us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265265.916027:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397479168 00000100:00100000:2.0:1789265265.916032:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 94 00000100:00100000:3.0:1789265265.916064:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 56 00000100:00100000:3.0:1789265265.916071:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1016d45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+5:2351:x1876180397479168:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789265265.916119:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1016d45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+5:2351:x1876180397479168:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 49us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265265.916126:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 56 00000100:00080000:3.0:1789265265.916141:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789265265.974628:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265265.974655:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789265265.974677:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102e765c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414290304:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789265265.974762:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265265.974936:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414290304 00000100:00100000:2.0:1789265265.974944:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414290304 00000100:00100000:2.0:1789265265.974996:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789265265.975005:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1016d46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1876180414290304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789265265.975040:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789265265.975118:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1016d46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1876180414290304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265265.975125:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789265265.975340:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102e765c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414290304:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789265266.032907:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265266.033384:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397479424 00000100:00100000:2.0:1789265266.033395:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397479424 00000100:00100000:3.0:1789265266.033562:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 262 00000100:00100000:3.0:1789265266.033574:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a100881f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+11:5588:x1876180397479424:12345-192.168.203.37@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265266.033609:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265266.033627:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a103fae8a00/0x27274ba5bb9520f5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x73b61075d99efdb9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265266.033657:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a103fae8a00/0x27274ba5bb9520f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efdb9 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265266.033669:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a103fae8a00/0x27274ba5bb9520f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efdb9 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265266.033679:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fae8a00, rc 0) 00000100:00100000:3.0:1789265266.033744:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a100881f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+12:5588:x1876180397479424:12345-192.168.203.37@tcp:101:ll_cfg_requeue.0 Request processed in 172us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265266.033752:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 262 00000100:00100000:1.0:1789265266.045586:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265266.045672:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397479552 00000100:00100000:0.0:1789265266.045683:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397479552 00000100:00100000:0.0:1789265266.045738:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 263 00000100:00100000:0.0:1789265266.045748:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a100881e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1230cd-a81b-4bcc-a532-e24f5353fef4+12:5588:x1876180397479552:12345-192.168.203.37@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789265266.046028:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a100881e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1230cd-a81b-4bcc-a532-e24f5353fef4+12:5588:x1876180397479552:12345-192.168.203.37@tcp:501:ll_cfg_requeue.0 Request processed in 280us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265266.046036:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 263 00000100:00100000:0.0:1789265266.048516:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265266.048596:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397479680 00000100:00100000:3.0:1789265266.048606:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397479680 00000100:00100000:3.0:1789265266.048657:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 264 00000100:00100000:3.0:1789265266.048665:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a100881a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+12:5588:x1876180397479680:12345-192.168.203.37@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789265266.049197:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a100881a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+12:5588:x1876180397479680:12345-192.168.203.37@tcp:503:ll_cfg_requeue.0 Request processed in 531us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265266.049208:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 264 00000100:00100000:1.0:1789265266.060206:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265266.060585:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397479808 00000100:00100000:2.0:1789265266.060596:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397479808 00000100:00100000:2.0:1789265266.060654:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 265 00000100:00100000:2.0:1789265266.060664:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a100881b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1230cd-a81b-4bcc-a532-e24f5353fef4+12:9933:x1876180397479808:12345-192.168.203.37@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789265266.061021:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a100881b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1230cd-a81b-4bcc-a532-e24f5353fef4+12:9933:x1876180397479808:12345-192.168.203.37@tcp:502:llog_process_th.0 Request processed in 356us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265266.061029:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 265 00000100:00100000:1.0:1789265266.064909:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265266.065012:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397479936 00000100:00100000:3.0:1789265266.065023:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397479936 00000100:00100000:3.0:1789265266.065150:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 266 00000100:00100000:3.0:1789265266.065162:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008818450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+12:9933:x1876180397479936:12345-192.168.203.37@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789265266.065433:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008818450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+12:9933:x1876180397479936:12345-192.168.203.37@tcp:502:llog_process_th.0 Request processed in 272us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265266.065447:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 266 00000100:00100000:0.0:1789265266.072483:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265266.072752:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397480064 00000100:00100000:3.0:1789265266.072762:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397480064 00000100:00100000:3.0:1789265266.072871:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 267 00000100:00100000:3.0:1789265266.072882:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a100881b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1230cd-a81b-4bcc-a532-e24f5353fef4+12:5588:x1876180397480064:12345-192.168.203.37@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265266.072899:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265266.072917:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a103fae9600/0x27274ba5bb9520fc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x73b61075d99efdc0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265266.072945:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a103fae9600/0x27274ba5bb9520fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efdc0 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265266.072955:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a103fae9600/0x27274ba5bb9520fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efdc0 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265266.072964:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fae9600, rc 0) 00000100:00100000:3.0:1789265266.073070:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a100881b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1230cd-a81b-4bcc-a532-e24f5353fef4+13:5588:x1876180397480064:12345-192.168.203.37@tcp:101:ll_cfg_requeue.0 Request processed in 190us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265266.073108:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 267 00000100:00100000:1.0:1789265266.077574:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265266.077652:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397480192 00000100:00100000:3.0:1789265266.077662:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397480192 00000100:00100000:3.0:1789265266.077717:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 268 00000100:00100000:3.0:1789265266.077727:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008819450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+13:5588:x1876180397480192:12345-192.168.203.37@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265266.078247:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008819450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+13:5588:x1876180397480192:12345-192.168.203.37@tcp:501:ll_cfg_requeue.0 Request processed in 518us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265266.078256:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 268 00000100:00100000:1.0:1789265266.081982:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265266.082118:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397480320 00000100:00100000:2.0:1789265266.082129:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397480320 00000100:00100000:2.0:1789265266.082181:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 269 00000100:00100000:2.0:1789265266.082190:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008819c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1230cd-a81b-4bcc-a532-e24f5353fef4+13:5588:x1876180397480320:12345-192.168.203.37@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265266.082441:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008819c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1230cd-a81b-4bcc-a532-e24f5353fef4+13:5588:x1876180397480320:12345-192.168.203.37@tcp:503:ll_cfg_requeue.0 Request processed in 251us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265266.082449:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 269 00000100:00100000:1.0:1789265266.087612:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265266.087703:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397480448 00000100:00100000:0.0:1789265266.087712:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397480448 00000100:00100000:0.0:1789265266.087769:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 270 00000100:00100000:0.0:1789265266.087780:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a100881bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1230cd-a81b-4bcc-a532-e24f5353fef4+13:9936:x1876180397480448:12345-192.168.203.37@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789265266.088035:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a100881bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1230cd-a81b-4bcc-a532-e24f5353fef4+13:9936:x1876180397480448:12345-192.168.203.37@tcp:502:llog_process_th.0 Request processed in 255us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265266.088043:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 270 00000100:00100000:1.0:1789265266.093429:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265266.093565:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397480576 00000100:00100000:3.0:1789265266.093575:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397480576 00000100:00100000:3.0:1789265266.093632:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 271 00000100:00100000:3.0:1789265266.093642:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008818c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+13:9936:x1876180397480576:12345-192.168.203.37@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789265266.093913:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008818c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+13:9936:x1876180397480576:12345-192.168.203.37@tcp:502:llog_process_th.0 Request processed in 272us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265266.093921:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 271 00000040:00080000:3.0:1789265266.867006:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789265266.994752:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265268.018684:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265269.042359:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265269.554434:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789265269.554469:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102e765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414290432:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789265269.554571:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265269.554704:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414290432 00000100:00100000:3.0:1789265269.554714:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414290432 00000100:00100000:3.0:1789265269.554778:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789265269.554789:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102e767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414290432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789265269.554823:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789265269.554875:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102e767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414290432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265269.554883:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:2.0:1789265269.555396:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789265269.555429:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a102e765500 x1876180414290432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265285 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265269.555460:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102e765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414290432:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1789265269.617374:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:3.0:1789265270.066290:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265270.578341:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1010f82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:871daf34-1206-40e7-bd71-78303abe4d37:3316:1876180414290560:0@lo:400:kworker.0 00000100:00100000:3.0:1789265270.578414:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265270.578723:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1010f81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414290944:0@lo:400:kworker.0 00000100:00100000:2.0:1789265270.578757:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265270.578805:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1010f83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876180414290688:0@lo:400:kworker.0 00000100:00100000:2.0:1789265270.578858:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265270.578877:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789265270.578883:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1010f83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1876180414290816:0@lo:400:kworker.0 00000100:00100000:2.0:1789265270.578905:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265270.578930:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414290688 00000100:00100000:2.0:1789265270.578937:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414290688 00000100:00100000:2.0:1789265270.578976:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414290816 00000100:00100000:2.0:1789265270.578979:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414290816 00000100:00100000:2.0:1789265270.579008:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789265270.579017:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102e766300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876180414290688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265270.579069:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102e766300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876180414290688:12345-0@lo:400:kworker.0 Request processed in 53us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265270.579114:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789265270.579132:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789265270.579139:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102e765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876180414290816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265270.579171:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102e765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876180414290816:12345-0@lo:400:kworker.0 Request processed in 33us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265270.579177:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789265270.579277:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414290560 00000100:00100000:1.0:1789265270.579283:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414290560 00000100:00100000:1.0:1789265270.579315:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1789265270.579332:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a100881b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+19:3316:x1876180414290560:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789265270.579396:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265270.579426:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1010f83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1876180414290816:0@lo:400:kworker.0 00000100:00100000:2.0:1789265270.579439:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1010f83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876180414290688:0@lo:400:kworker.0 00000100:00100000:2.0:1789265270.579504:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414290944 00000100:00100000:2.0:1789265270.579509:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414290944 00000100:00100000:2.0:1789265270.579536:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789265270.579542:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102e765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414290944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265270.579579:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102e765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414290944:12345-0@lo:400:kworker.0 Request processed in 37us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265270.579585:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:2.0:1789265270.579616:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1010f81180 x1876180414290944/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265270.579626:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1010f81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414290944:0@lo:400:kworker.0 00000100:00100000:0.0:1789265270.579786:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789265270.579797:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1010f83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414291200:0@lo:400:kworker.0 00000100:00100000:0.0:1789265270.579837:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265270.579963:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789265270.579971:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1010f80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1876180414291072:0@lo:400:kworker.0 00000100:00100000:2.0:1789265270.579998:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265270.580041:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414291200 00000100:00100000:2.0:1789265270.580045:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414291200 00000100:00100000:2.0:1789265270.580103:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789265270.580110:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1010f81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1876180414291200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265270.580143:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1010f81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1876180414291200:12345-0@lo:400:kworker.0 Request processed in 33us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265270.580149:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:2.0:1789265270.580163:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789265270.580375:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a100881b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+19:3316:x1876180414290560:12345-0@lo:400:kworker.0 Request processed in 1043us (1959us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265270.580383:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1789265270.580474:0:3318:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:0.0:1789265270.580480:0:3318:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a103bb04e00, transno 4294967300 00000100:00100000:0.0:1789265270.580498:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1010f83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414291200:0@lo:400:kworker.0 00000100:00100000:0.0:1789265270.580519:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414291072 00000100:00100000:0.0:1789265270.580523:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414291072 00000100:00100000:0.0:1789265270.580563:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789265270.580570:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102e765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876180414291072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265270.580607:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102e765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876180414291072:12345-0@lo:400:kworker.0 Request processed in 38us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265270.580613:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789265270.580642:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1010f80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1876180414291072:0@lo:400:kworker.0 00000100:00080000:1.0:1789265270.580701:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265270.581297:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1010f82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:871daf34-1206-40e7-bd71-78303abe4d37:3316:1876180414290560:0@lo:400:kworker.0 00000100:00100000:1.0:1789265271.026756:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265271.026797:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265271.026853:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265271.026881:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265271.027339:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397480832 00000100:00100000:0.0:1789265271.027350:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397480832 00000100:00100000:0.0:1789265271.027476:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397481088 00000100:00100000:0.0:1789265271.027480:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397481088 00000100:00100000:0.0:1789265271.027501:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 99 00000100:00100000:0.0:1789265271.027509:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c07b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+5:2349:x1876180397480832:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789265271.027612:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c07b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+5:2349:x1876180397480832:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 103us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265271.027619:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 99 00000100:00100000:0.0:1789265271.027634:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 100 00000100:00100000:0.0:1789265271.027640:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c079f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+5:2349:x1876180397481088:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789265271.027669:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c079f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+5:2349:x1876180397481088:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 30us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265271.027676:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 100 00000100:00080000:1.0:1789265271.027876:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265271.028303:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397480704 00000100:00100000:3.0:1789265271.028309:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397480704 00000100:00100000:3.0:1789265271.028357:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 273 00000100:00100000:3.0:1789265271.028365:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a100881a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1230cd-a81b-4bcc-a532-e24f5353fef4+13:2349:x1876180397480704:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789265271.028480:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a100881a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1230cd-a81b-4bcc-a532-e24f5353fef4+13:2349:x1876180397480704:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 116us (1626us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265271.028496:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 273 00000100:00100000:2.0:1789265271.028592:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397480960 00000100:00100000:2.0:1789265271.028597:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397480960 00000100:00100000:2.0:1789265271.028643:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 59 00000100:00100000:2.0:1789265271.028650:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c07a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+5:2349:x1876180397480960:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789265271.028680:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c07a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+5:2349:x1876180397480960:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 31us (1798us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265271.028686:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 59 00000100:00080000:3.0:1789265271.028755:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789265271.091405:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102e764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414291328:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789265271.091489:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789265271.091982:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265271.092483:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414291328 00000100:00100000:2.0:1789265271.092493:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414291328 00000100:00100000:2.0:1789265271.092548:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789265271.092557:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1010f80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876180414291328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789265271.092592:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789265271.092659:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1010f80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876180414291328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (1170us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265271.092666:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789265271.093476:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102e764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414291328:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789265272.114431:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265273.138799:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265274.163138:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265274.679917:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102e766a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414291456:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789265274.679995:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265274.682679:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414291456 00000100:00100000:0.0:1789265274.682694:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414291456 00000100:00100000:0.0:1789265274.682750:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789265274.682760:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1010f83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414291456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789265274.682794:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789265274.682873:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1010f83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414291456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (2878us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265274.682880:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:0.0:1789265274.682994:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789265274.683034:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a102e766a00 x1876180414291456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265290 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265274.683055:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102e766a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414291456:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789265275.186797:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265275.699198:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10088e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414291968:0@lo:400:kworker.0 00000100:00100000:0.0:1789265275.699281:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265275.699358:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789265275.699365:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102e764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:871daf34-1206-40e7-bd71-78303abe4d37:3315:1876180414291584:0@lo:400:kworker.0 00000100:00100000:0.0:1789265275.699407:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265275.699434:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10088e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1876180414292096:0@lo:400:kworker.0 00000100:00100000:0.0:1789265275.699460:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265275.699484:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102e764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1876180414291840:0@lo:400:kworker.0 00000100:00100000:0.0:1789265275.699504:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265275.699520:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789265275.699525:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102e766a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876180414291712:0@lo:400:kworker.0 00000100:00100000:0.0:1789265275.699671:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265275.699690:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10088e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414292224:0@lo:400:kworker.0 00000100:00100000:0.0:1789265275.699709:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265275.699736:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414291584 00000100:00100000:0.0:1789265275.699743:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414291584 00000100:00100000:0.0:1789265275.699783:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1789265275.699792:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008819850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+19:3315:x1876180414291584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265275.699840:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008819850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+19:3315:x1876180414291584:12345-0@lo:400:kworker.0 Request processed in 49us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265275.699847:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1789265275.699876:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414292096 00000100:00100000:0.0:1789265275.699880:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414292096 00000100:00100000:2.0:1789265275.699984:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414291968 00000100:00100000:2.0:1789265275.699989:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414291968 00000100:00100000:2.0:1789265275.700020:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414292224 00000100:00100000:2.0:1789265275.700023:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414292224 00000100:00100000:2.0:1789265275.700049:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789265275.700055:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1010f83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414291968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265275.700131:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414291840 00000100:00100000:1.0:1789265275.700136:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414291840 00000100:00100000:2.0:1789265275.700141:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1010f83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414291968:12345-0@lo:400:kworker.0 Request processed in 84us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265275.700149:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789265275.700165:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789265275.700173:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1876180414292224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265275.700185:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414291712 00000100:00100000:1.0:1789265275.700190:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414291712 00000100:00100000:1.0:1789265275.700212:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789265275.700214:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1876180414292224:12345-0@lo:400:kworker.0 Request processed in 42us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265275.700223:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1010f82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1876180414291840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265275.700224:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:2.0:1789265275.700250:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789265275.700256:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789265275.700272:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1010f82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1876180414291840:12345-0@lo:400:kworker.0 Request processed in 50us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265275.700273:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789265275.700297:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876180414291712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265275.700298:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789265275.700335:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876180414291712:12345-0@lo:400:kworker.0 Request processed in 52us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265275.700344:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789265275.700367:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102e764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:871daf34-1206-40e7-bd71-78303abe4d37:3315:1876180414291584:0@lo:400:kworker.0 00000100:00100000:2.0:1789265275.700384:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102e766a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876180414291712:0@lo:400:kworker.0 00010000:00080000:1.0:1789265275.700390:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a10088e5c00 x1876180414291968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265275.700403:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10088e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414292224:0@lo:400:kworker.0 00000100:00100000:1.0:1789265275.700404:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10088e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414291968:0@lo:400:kworker.0 00000100:00100000:2.0:1789265275.700424:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102e764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1876180414291840:0@lo:400:kworker.0 00000100:00100000:0.0:1789265275.700767:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789265275.700775:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1010f83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876180414292096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265275.700815:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1010f83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876180414292096:12345-0@lo:400:kworker.0 Request processed in 40us (1354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265275.700822:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789265275.700854:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10088e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1876180414292096:0@lo:400:kworker.0 00000100:00080000:2.0:1789265275.702181:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1789265276.082728:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789265276.162181:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265276.162222:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265276.162251:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265276.162289:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265276.162320:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397481344 00000100:00100000:1.0:1789265276.162330:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397481344 00000100:00100000:1.0:1789265276.162379:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397481600 00000100:00100000:1.0:1789265276.162382:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397481600 00000100:00100000:1.0:1789265276.162399:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 104 00000100:00100000:1.0:1789265276.162408:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c07aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+5:2351:x1876180397481344:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789265276.162448:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397481216 00000100:00100000:0.0:1789265276.162454:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397481216 00000100:00100000:1.0:1789265276.162490:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c07aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+5:2351:x1876180397481344:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 82us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265276.162498:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 275 00000100:00100000:1.0:1789265276.162501:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 104 00000100:00100000:0.0:1789265276.162511:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008818050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+13:2351:x1876180397481216:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789265276.162523:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 105 00000100:00100000:1.0:1789265276.162531:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c078000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+5:2351:x1876180397481600:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789265276.162548:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008818050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+13:2351:x1876180397481216:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 39us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265276.162556:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 275 00000100:00100000:1.0:1789265276.162560:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c078000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+5:2351:x1876180397481600:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 28us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265276.162568:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 105 00000100:00080000:2.0:1789265276.163307:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265276.163322:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397481472 00000100:00100000:2.0:1789265276.163326:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397481472 00000100:00100000:2.0:1789265276.163378:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 62 00000100:00100000:2.0:1789265276.163385:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c07bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+5:2351:x1876180397481472:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789265276.163422:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c07bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+5:2351:x1876180397481472:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 38us (1200us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265276.163435:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 62 00000100:00080000:0.0:1789265276.163468:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789265276.210264:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789265276.210299:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10088e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414292352:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789265276.210366:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789265276.210485:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265276.210699:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414292352 00000100:00100000:0.0:1789265276.210708:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414292352 00000100:00100000:0.0:1789265276.210775:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789265276.210785:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10088e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876180414292352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789265276.210983:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789265276.211044:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10088e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876180414292352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 260us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265276.211052:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789265276.211363:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10088e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414292352:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789265277.234285:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265278.258456:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265279.282384:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265279.794929:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789265279.794952:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10088e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414292480:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789265279.795023:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265279.795118:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414292480 00000100:00100000:2.0:1789265279.795127:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414292480 00000100:00100000:2.0:1789265279.795183:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789265279.795194:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10088e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414292480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789265279.795230:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789265279.795281:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789265279.795301:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10088e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414292480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265279.795310:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:2.0:1789265279.795352:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a10088e7b80 x1876180414292480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265295 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265279.795370:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10088e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414292480:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789265280.306271:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265280.818627:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1008757b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1876180414292864:0@lo:400:kworker.0 00000100:00100000:3.0:1789265280.818690:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876180414292736:0@lo:400:kworker.0 00000100:00100000:0.0:1789265280.818696:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265280.818761:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1008756a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414292992:0@lo:400:kworker.0 00000100:00100000:2.0:1789265280.818835:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:871daf34-1206-40e7-bd71-78303abe4d37:3316:1876180414292608:0@lo:400:kworker.0 00000100:00100000:3.0:1789265280.828791:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265280.828880:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103fa65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414293248:0@lo:400:kworker.0 00000100:00100000:3.0:1789265280.828926:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265280.829504:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414292864 00000100:00100000:3.0:1789265280.829513:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414292864 00000100:00100000:3.0:1789265280.829639:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414292736 00000100:00100000:3.0:1789265280.829643:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414292736 00000100:00100000:3.0:1789265280.829667:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789265280.829755:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008e25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1876180414292864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265280.829890:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008e25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1876180414292864:12345-0@lo:400:kworker.0 Request processed in 139us (11192us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265280.829897:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789265280.829915:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789265280.829922:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bb04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876180414292736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265280.830061:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bb04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876180414292736:12345-0@lo:400:kworker.0 Request processed in 139us (1388us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265280.830106:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:3.0:1789265280.830126:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265280.830166:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876180414292736:0@lo:400:kworker.0 00000100:00100000:3.0:1789265280.830212:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414293248 00000100:00100000:3.0:1789265280.830216:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414293248 00000100:00100000:3.0:1789265280.830267:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789265280.830274:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bb05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1876180414293248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265280.830315:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bb05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1876180414293248:12345-0@lo:400:kworker.0 Request processed in 41us (1386us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265280.830321:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:3.0:1789265280.830335:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789265280.830353:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103fa65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414293248:0@lo:400:kworker.0 00000100:00100000:1.0:1789265280.830430:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265280.830460:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414292992 00000100:00100000:1.0:1789265280.830464:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414292992 00000100:00100000:1.0:1789265280.830490:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789265280.830496:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102e764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414292992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265280.830528:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102e764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414292992:12345-0@lo:400:kworker.0 Request processed in 33us (98us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265280.830534:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:1.0:1789265280.830572:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1008756a00 x1876180414292992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265280.830582:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1008756a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414292992:0@lo:400:kworker.0 00000100:00100000:0.0:1789265280.830695:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1008757b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1876180414292864:0@lo:400:kworker.0 00000100:00100000:2.0:1789265280.830773:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265280.830810:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1876180414293120:0@lo:400:kworker.0 00000100:00100000:2.0:1789265280.830848:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265280.831010:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414292608 00000100:00100000:0.0:1789265280.831015:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414292608 00000100:00100000:0.0:1789265280.831046:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1789265280.831052:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a100881a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+19:3316:x1876180414292608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265280.831101:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a100881a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+19:3316:x1876180414292608:12345-0@lo:400:kworker.0 Request processed in 48us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265280.831116:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1789265280.831247:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:871daf34-1206-40e7-bd71-78303abe4d37:3316:1876180414292608:0@lo:400:kworker.0 00000100:00100000:1.0:1789265280.831366:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414293120 00000100:00100000:1.0:1789265280.831371:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414293120 00000100:00100000:1.0:1789265280.831409:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789265280.831415:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10088e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876180414293120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265280.831453:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10088e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876180414293120:12345-0@lo:400:kworker.0 Request processed in 38us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265280.831459:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:2.0:1789265280.832095:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265280.832130:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1876180414293120:0@lo:400:kworker.0 00000100:00100000:1.0:1789265281.267130:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265281.267177:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265281.267343:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397481856 00000100:00100000:3.0:1789265281.267354:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397481856 00000100:00100000:2.0:1789265281.267361:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397481728 00000100:00100000:2.0:1789265281.267367:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397481728 00000100:00100000:3.0:1789265281.267424:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 109 00000100:00100000:2.0:1789265281.267425:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 277 00000100:00100000:3.0:1789265281.267439:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102e766a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+5:2351:x1876180397481856:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789265281.267441:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008818850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1230cd-a81b-4bcc-a532-e24f5353fef4+13:2351:x1876180397481728:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789265281.267521:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008818850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1230cd-a81b-4bcc-a532-e24f5353fef4+13:2351:x1876180397481728:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 85us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265281.267530:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 277 00000100:00080000:1.0:1789265281.268180:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265281.271965:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102e766a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+5:2351:x1876180397481856:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 4516us (4772us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265281.271979:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 109 00000100:00100000:1.0:1789265281.283981:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265281.284072:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397482112 00000100:00100000:3.0:1789265281.284122:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397482112 00000100:00100000:3.0:1789265281.284196:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 110 00000100:00100000:3.0:1789265281.284207:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102e764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+5:2351:x1876180397482112:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789265281.284298:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102e764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+5:2351:x1876180397482112:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 92us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265281.284322:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 110 00000100:00080000:1.0:1789265281.284466:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265281.303205:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265281.303356:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397481984 00000100:00100000:3.0:1789265281.303367:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397481984 00000100:00100000:3.0:1789265281.303443:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 19 00000100:00100000:3.0:1789265281.303455:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10031fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+5:2347:x1876180397481984:12345-192.168.203.37@tcp:9:kworker.0 00000020:00000080:3.0:1789265281.303483:0:8856:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x27274ba5bb952038 00000100:00080000:3.0:1789265281.303492:0:8856:0:(import.c:65:import_set_state_nolock()) ffff8a103fbd8000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789265281.303541:0:8856:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:0.0:1789265281.303902:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789265281.303962:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789265281.305001:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10031fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+2:2347:x1876180397481984:12345-192.168.203.37@tcp:9:kworker.0 Request processed in 1542us (1801us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265281.305013:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 19 00000100:00100000:2.0:1789265281.331198:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789265281.331221:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10088e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414293376:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789265281.331297:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265281.331307:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265281.331367:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414293376 00000100:00100000:3.0:1789265281.331375:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414293376 00000100:00100000:3.0:1789265281.331482:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789265281.331492:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10088e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876180414293376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789265281.331537:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789265281.331596:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10088e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876180414293376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265281.331604:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789265281.331683:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10088e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414293376:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789265282.357925:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265283.379995:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265284.410998:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265284.915377:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789265284.915398:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10088e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414293504:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789265284.915459:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265284.915528:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414293504 00000100:00100000:2.0:1789265284.915541:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414293504 00000100:00100000:2.0:1789265284.915594:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789265284.915603:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10088e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414293504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789265284.915635:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789265284.915793:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10088e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414293504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 190us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265284.915800:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:2.0:1789265284.915856:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a10088e5f80 x1876180414293504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265300 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265284.915873:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10088e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414293504:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789265284.918219:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:2.0:1789265284.957607:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4b820fcb-1bab-4b78-bfa4-355c22a09cf8 00000020:00000080:2.0:1789265284.957618:0:7633:0:(genops.c:885:class_export_put()) final put ffff8a103fbde000/4b820fcb-1bab-4b78-bfa4-355c22a09cf8 00000020:00000080:0.0:1789265284.958304:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a103fbde000/4b820fcb-1bab-4b78-bfa4-355c22a09cf8 for lustre-OST0001 00000020:00000080:0.0:1789265284.958802:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a103fbd8000 for lustre-OST0001 00010000:00010000:3.0:1789265285.427213:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265285.938554:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103bb05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414294016:0@lo:400:kworker.0 00000100:00100000:0.0:1789265285.938625:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265285.938632:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103bb04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:871daf34-1206-40e7-bd71-78303abe4d37:3316:1876180414293632:0@lo:400:kworker.0 00000100:00100000:3.0:1789265285.938694:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414294016 00000100:00100000:3.0:1789265285.938702:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414294016 00000100:00100000:3.0:1789265285.938752:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789265285.938761:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10031fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414294016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265285.946962:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265285.947033:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103bb07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1876180414294144:0@lo:400:kworker.0 00000100:00100000:2.0:1789265285.947091:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265285.947747:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414293632 00000100:00100000:2.0:1789265285.947759:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414293632 00000100:00100000:2.0:1789265285.947816:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1789265285.947828:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a100881ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+19:3316:x1876180414293632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265285.947897:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a100881ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+19:3316:x1876180414293632:12345-0@lo:400:kworker.0 Request processed in 71us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265285.947906:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1789265285.947945:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414294144 00000100:00100000:2.0:1789265285.947949:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414294144 00000100:00100000:2.0:1789265285.947994:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789265285.948001:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10088e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876180414294144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265285.948036:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10088e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876180414294144:12345-0@lo:400:kworker.0 Request processed in 36us (944us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265285.948042:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789265285.948866:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103bb04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:871daf34-1206-40e7-bd71-78303abe4d37:3316:1876180414293632:0@lo:400:kworker.0 00000100:00100000:2.0:1789265285.948889:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103bb07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1876180414294144:0@lo:400:kworker.0 00000100:00100000:2.0:1789265285.949003:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103bb07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876180414293760:0@lo:400:kworker.0 00000100:00100000:2.0:1789265285.949044:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265285.949092:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103bb07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414294272:0@lo:400:kworker.0 00000100:00100000:2.0:1789265285.949607:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265285.949637:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789265285.949645:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103bb05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1876180414293888:0@lo:400:kworker.0 00000100:00100000:2.0:1789265285.949672:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265285.950226:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414294272 00000100:00100000:2.0:1789265285.950233:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414294272 00000100:00100000:2.0:1789265285.950279:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789265285.950289:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c0d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1876180414294272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265285.950347:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c0d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1876180414294272:12345-0@lo:400:kworker.0 Request processed in 60us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265285.950354:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789265285.950385:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103bb07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414294272:0@lo:400:kworker.0 00000100:00100000:2.0:1789265285.950421:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414293760 00000100:00100000:2.0:1789265285.950425:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414293760 00000100:00100000:2.0:1789265285.950446:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414293888 00000100:00100000:2.0:1789265285.950449:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414293888 00000100:00100000:2.0:1789265285.950467:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789265285.950473:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10088e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876180414293760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265285.951920:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10088e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876180414293760:12345-0@lo:400:kworker.0 Request processed in 1441us (2870us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265285.951930:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789265285.951957:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789265285.951965:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10349cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876180414293888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265285.952013:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10349cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876180414293888:12345-0@lo:400:kworker.0 Request processed in 49us (2340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265285.952019:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789265285.952066:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103bb05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1876180414293888:0@lo:400:kworker.0 00000100:00100000:2.0:1789265285.952095:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103bb07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876180414293760:0@lo:400:kworker.0 00000100:00100000:2.0:1789265285.956985:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10031fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414294016:12345-0@lo:400:kworker.0 Request processed in 18216us (18351us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265285.957001:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:0.0:1789265285.961372:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a103bb05880 x1876180414294016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265285.961391:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103bb05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414294016:0@lo:400:kworker.0 00000100:00080000:0.0:1789265285.961425:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789265285.961431:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:2.0:1789265286.324812:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789265286.384763:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265286.384834:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265286.384882:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265286.384926:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397482368 00000100:00100000:2.0:1789265286.384939:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397482368 00000100:00100000:2.0:1789265286.385011:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397482496 00000100:00100000:2.0:1789265286.385014:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397482496 00000100:00100000:2.0:1789265286.385043:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 114 00000100:00100000:2.0:1789265286.385054:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10349ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+5:2349:x1876180397482368:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789265286.385201:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10349ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+5:2349:x1876180397482368:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 147us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265286.385223:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 114 00000100:00100000:2.0:1789265286.385245:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 115 00000100:00100000:2.0:1789265286.385252:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10349cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+5:2349:x1876180397482496:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789265286.385279:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10349cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+5:2349:x1876180397482496:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 28us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265286.385308:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 115 00000100:00080000:2.0:1789265286.385328:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265286.385511:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397482240 00000100:00100000:1.0:1789265286.385518:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397482240 00000100:00100000:1.0:1789265286.385559:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 279 00000100:00100000:1.0:1789265286.385567:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008819050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1230cd-a81b-4bcc-a532-e24f5353fef4+13:2349:x1876180397482240:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789265286.385608:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008819050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1230cd-a81b-4bcc-a532-e24f5353fef4+13:2349:x1876180397482240:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 43us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265286.385616:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 279 00010000:00010000:1.0:1789265286.453635:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265286.454195:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10349cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414294400:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789265286.454305:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265286.455047:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414294400 00000100:00100000:2.0:1789265286.455061:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414294400 00000100:00100000:2.0:1789265286.455163:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789265286.455174:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10031fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876180414294400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789265286.455235:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789265286.455330:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10031fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876180414294400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 157us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265286.455338:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789265286.455511:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10349cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414294400:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789265287.475013:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265288.500518:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789265288.682829:0:11837:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 22:08:07 (1789265287) 00010000:00010000:0.0:1789265289.522378:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265290.036801:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789265290.036825:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103bb06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414294528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789265290.036933:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265290.037008:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414294528 00000100:00100000:2.0:1789265290.037016:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414294528 00000100:00100000:2.0:1789265290.037115:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789265290.037125:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10349c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414294528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789265290.037161:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789265290.037162:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789265290.037231:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10349c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414294528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265290.037239:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:1.0:1789265290.037397:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a103bb06300 x1876180414294528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265306 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265290.037419:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103bb06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414294528:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789265290.553278:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265290.665777:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265290.665879:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397482624 00000100:00100000:3.0:1789265290.665903:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397482624 00000100:00100000:3.0:1789265290.665988:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 32 00000100:00100000:3.0:1789265290.665998:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10349ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+5:10205:x1876180397482624:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789265290.666041:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265290.666113:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8000/0x27274ba5bb952103 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99efdc7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265290.666198:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb95210a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265290.666211:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb95210a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265290.666223:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb95210a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265290.666267:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789265290.666270:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789265290.667595:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb95210a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265290.667633:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8000/0x27274ba5bb952103 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efdc7 expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265290.667654:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb95210a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efdc7 expref: 6 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265290.667663:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1032d00600) 00010000:00010000:3.0:1789265290.667678:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789265290.667681:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fae8e00, rc 0) 00000100:00100000:3.0:1789265290.667763:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10349ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:10205:x1876180397482624:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 1766us (2004us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265290.667772:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 32 00000100:00080000:2.0:1789265290.668363:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265290.679214:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265290.679759:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397482752 00000100:00100000:2.0:1789265290.679910:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397482752 00000100:00100000:2.0:1789265290.680023:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 33 00000100:00100000:2.0:1789265290.680045:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008757b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:10206:x1876180397482752:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789265290.680107:0:7934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265290.680127:0:7934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6400/0x27274ba5bb952111 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99efdce expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265290.680194:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952118 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265290.680209:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952118 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265290.680221:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952118 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265290.680235:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb95211f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265290.680242:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb95211f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265290.680249:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb95211f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265290.680485:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6e00/0x27274ba5bb952126 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265290.680494:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6e00/0x27274ba5bb952126 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265290.680501:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6e00/0x27274ba5bb952126 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265290.680528:0:7934:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789265290.680537:0:7934:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789265290.680561:0:7934:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6e00/0x27274ba5bb952126 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265290.680571:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952118 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265290.680577:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952118 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265290.680583:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952118 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265290.680589:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad7a00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789265290.680594:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952118 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265290.680601:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952118 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265290.680614:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1032d00600) 00010000:00010000:2.0:1789265290.680631:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265290.680636:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952118 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265290.680642:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952118 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265290.680653:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb95211f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265290.680659:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb95211f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265290.680674:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb95211f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265290.680680:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad7000 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789265290.680683:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb95211f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265290.680690:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb95211f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265290.680698:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8a1012931200) 00010000:00010000:2.0:1789265290.680701:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265290.680704:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb95211f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265290.680710:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb95211f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265290.680741:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6400/0x27274ba5bb952111 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efdce expref: 8 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265290.680756:0:7934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6e00/0x27274ba5bb952126 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efdce expref: 7 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265290.680775:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8a1012931500) 00010000:00010000:2.0:1789265290.680778:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789265290.680780:0:7934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fad6e00, rc 0) 00000100:00100000:2.0:1789265290.680860:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008757b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+7:10206:x1876180397482752:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 827us (1655us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265290.680876:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 33 00000100:00100000:2.0:1789265290.688220:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265290.688277:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397483008 00000100:00100000:3.0:1789265290.688287:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397483008 00000100:00100000:3.0:1789265290.688355:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 34 00000100:00100000:3.0:1789265290.688365:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10349cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+7:10206:x1876180397483008:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789265290.688386:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265290.688406:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8000/0x27274ba5bb95212d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99efdd5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265290.688472:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb952134 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265290.688485:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb952134 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265290.688497:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb952134 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265290.688558:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb95213b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265290.688567:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb95213b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265290.688575:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb95213b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265290.688959:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9800/0x27274ba5bb952142 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265290.688980:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9800/0x27274ba5bb952142 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265290.688988:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9800/0x27274ba5bb952142 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265290.688998:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1789265290.689220:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb952134 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265290.689228:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb952134 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265290.689236:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb952134 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265290.689242:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fae9a00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789265290.689246:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb952134 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265290.689254:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb952134 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265290.689266:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8a1012931500) 00010000:00010000:3.0:1789265290.689269:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265290.689273:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb952134 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265290.689291:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb952134 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265290.689301:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb95213b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265290.689306:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb95213b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265290.689312:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb95213b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265290.689316:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fae8800 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789265290.689319:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb95213b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265290.689324:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb95213b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265290.689332:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8a1032d00e00) 00010000:00010000:3.0:1789265290.689334:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265290.689336:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb95213b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265290.689341:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb95213b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265290.689782:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8000/0x27274ba5bb95212d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efdd5 expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265290.689796:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9800/0x27274ba5bb952142 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efdd5 expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265290.689809:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a1032d00f00) 00010000:00010000:3.0:1789265290.689811:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265290.689813:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fae9800, rc 0) 00000100:00100000:3.0:1789265290.689881:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10349cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+9:10206:x1876180397483008:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 1517us (1668us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1789265290.689890:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 34 00000100:00100000:1.0:1789265290.698990:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265290.699123:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397483136 00000100:00100000:3.0:1789265290.699134:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397483136 00000100:00100000:3.0:1789265290.699209:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 35 00000100:00100000:3.0:1789265290.699219:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008756a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+9:10206:x1876180397483136:12345-192.168.203.37@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789265290.699414:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008756a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+9:10206:x1876180397483136:12345-192.168.203.37@tcp:59:lhsmtool_posix.0 Request processed in 195us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265290.699422:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 35 00000100:00100000:3.0:1789265291.058732:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103bb05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1876180414294912:0@lo:400:kworker.0 00000100:00100000:3.0:1789265291.058793:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265291.058888:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789265291.058895:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103bb06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876180414294784:0@lo:400:kworker.0 00000100:00100000:3.0:1789265291.058917:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265291.058934:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103bb07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414295296:0@lo:400:kworker.0 00000100:00100000:3.0:1789265291.058954:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265291.058981:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414294912 00000100:00100000:3.0:1789265291.058988:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414294912 00000100:00100000:2.0:1789265291.059025:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414295296 00000100:00100000:2.0:1789265291.059029:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414295296 00000100:00100000:3.0:1789265291.059045:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414294784 00000100:00100000:3.0:1789265291.059048:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414294784 00000100:00100000:3.0:1789265291.059068:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789265291.059068:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789265291.059095:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bb04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1876180414295296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265291.059104:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bb07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1876180414294912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265291.059191:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103bb07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414295040:0@lo:400:kworker.0 00000100:00100000:0.0:1789265291.059220:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265291.059246:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789265291.059252:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103bb06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:871daf34-1206-40e7-bd71-78303abe4d37:3315:1876180414294656:0@lo:400:kworker.0 00000100:00100000:0.0:1789265291.059279:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265291.059299:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103bb05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1876180414295168:0@lo:400:kworker.0 00000100:00100000:0.0:1789265291.059320:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265291.059366:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414295040 00000100:00100000:0.0:1789265291.059371:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414295040 00000100:00100000:0.0:1789265291.059395:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789265291.059401:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10031fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414295040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265291.059435:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10031fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414295040:12345-0@lo:400:kworker.0 Request processed in 33us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265291.059442:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789265291.059466:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414295168 00000100:00100000:0.0:1789265291.059469:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414295168 00000100:00100000:0.0:1789265291.059484:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789265291.059490:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bb04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876180414294784:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789265291.059564:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789265291.059570:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265291.059601:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bb04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1876180414295296:12345-0@lo:400:kworker.0 Request processed in 508us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265291.059607:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789265291.059628:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414294656 00000100:00100000:2.0:1789265291.059631:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414294656 00000100:00100000:2.0:1789265291.059655:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1789265291.059662:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+19:3315:x1876180414294656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265291.059696:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+19:3315:x1876180414294656:12345-0@lo:400:kworker.0 Request processed in 34us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265291.059702:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1789265291.059743:0:5840:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1789265291.059750:0:5840:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:2.0:1789265291.059875:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789265291.059882:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10031ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876180414295168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265291.059914:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10031ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876180414295168:12345-0@lo:400:kworker.0 Request processed in 32us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265291.059920:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789265291.061419:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bb07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1876180414294912:12345-0@lo:400:kworker.0 Request processed in 2310us (2620us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265291.061429:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789265291.067525:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103bb06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:871daf34-1206-40e7-bd71-78303abe4d37:3315:1876180414294656:0@lo:400:kworker.0 00000100:00100000:0.0:1789265291.067526:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bb04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876180414294784:12345-0@lo:400:kworker.0 Request processed in 8026us (8599us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265291.067543:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789265291.067551:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103bb05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1876180414295168:0@lo:400:kworker.0 00010000:00080000:1.0:1789265291.067570:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a103bb07800 x1876180414295040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265307 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265291.067580:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103bb07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414295040:0@lo:400:kworker.0 00000100:00100000:3.0:1789265291.067911:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103bb06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876180414294784:0@lo:400:kworker.0 00000100:00100000:3.0:1789265291.067925:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103bb07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414295296:0@lo:400:kworker.0 00000100:00100000:3.0:1789265291.067936:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103bb05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1876180414294912:0@lo:400:kworker.0 00000040:00080000:1.0:1789265291.443120:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789265291.511876:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265291.511928:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265291.511961:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397483520 00000100:00100000:3.0:1789265291.511971:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397483520 00000100:00100000:3.0:1789265291.512032:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 119 00000100:00100000:3.0:1789265291.512042:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bb05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+5:2350:x1876180397483520:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789265291.512144:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bb05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+5:2350:x1876180397483520:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 102us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265291.512151:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 119 00000100:00080000:3.0:1789265291.512170:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265291.512490:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397483264 00000100:00100000:0.0:1789265291.512495:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397483264 00000100:00100000:0.0:1789265291.512528:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 281 00000100:00100000:0.0:1789265291.512536:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+13:2350:x1876180397483264:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789265291.512570:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+13:2350:x1876180397483264:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 35us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265291.512577:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 281 00000100:00100000:1.0:1789265291.524999:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265291.528154:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397483392 00000100:00100000:3.0:1789265291.528167:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397483392 00000100:00100000:3.0:1789265291.528235:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 120 00000100:00100000:3.0:1789265291.528245:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1009072a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+9:2350:x1876180397483392:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789265291.528393:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1009072a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+9:2350:x1876180397483392:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 149us (3402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265291.528401:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 120 00000100:00100000:2.0:1789265291.570670:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789265291.570691:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c0d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414295424:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789265291.570758:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265291.570838:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414295424 00000100:00100000:2.0:1789265291.570847:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414295424 00000100:00100000:2.0:1789265291.570894:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789265291.570902:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c0d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876180414295424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789265291.570938:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789265291.570984:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c0d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876180414295424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265291.570991:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789265291.571038:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c0d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414295424:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789265291.571261:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265292.599820:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265292.618733:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265292.618810:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397483648 00000100:00100000:2.0:1789265292.618821:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397483648 00000100:00100000:2.0:1789265292.618903:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 36 00000100:00100000:2.0:1789265292.618914:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10031fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+9:10248:x1876180397483648:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:2.0:1789265292.618934:0:7934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265292.618953:0:7934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7600/0x27274ba5bb952150 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99efddc expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789265292.618995:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789265292.619012:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952157 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265292.619027:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952157 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265292.619049:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952157 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265292.619064:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb95215e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265292.619095:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb95215e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265292.619103:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb95215e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265292.619668:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952157 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265292.619677:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952157 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265292.619685:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952157 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265292.619692:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad6000 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789265292.619696:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952157 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265292.619703:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952157 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265292.619715:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1032d00600) 00010000:00010000:2.0:1789265292.619719:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265292.619723:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952157 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265292.619728:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952157 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265292.619739:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb95215e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265292.619752:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb95215e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265292.619757:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb95215e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265292.619762:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad7a00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789265292.619765:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb95215e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265292.619770:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb95215e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265292.619777:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8a1012931e00) 00010000:00010000:2.0:1789265292.619780:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265292.619782:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb95215e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265292.619787:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb95215e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265292.619821:0:7934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7600/0x27274ba5bb952150 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efddc expref: 10 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265292.621725:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1032d00600) 00010000:00010000:2.0:1789265292.621733:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265292.621743:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7600/0x27274ba5bb952150 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efddc expref: 10 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265292.621760:0:7934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fad7600, rc 0) 00000100:00100000:2.0:1789265292.621847:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10031fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+9:10248:x1876180397483648:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 2933us (3122us total) trans 0 rc 301/301 00000100:00100000:2.0:1789265292.621856:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 36 00000100:00100000:3.0:1789265292.633786:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265292.633821:0:11857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397483904 00000100:00100000:3.0:1789265292.633831:0:11857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397483904 00000100:00100000:3.0:1789265292.633882:0:11857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 37 00000100:00100000:3.0:1789265292.633892:0:11857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bb07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+9:10248:x1876180397483904:12345-192.168.203.37@tcp:36:lfs.0 00010000:00010000:3.0:1789265292.633958:0:11857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265292.633987:0:11857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb95210a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efdc7 expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265292.634004:0:11857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1032d00600) 00010000:00010000:3.0:1789265292.634015:0:11857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789265292.634254:0:11857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb952165 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265292.634268:0:11857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb952165 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265292.634277:0:11857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb952165 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265292.634287:0:11857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8000/0x27274ba5bb95216c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265292.634293:0:11857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8000/0x27274ba5bb95216c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265292.634300:0:11857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8000/0x27274ba5bb95216c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265292.635249:0:11857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789265292.635268:0:11857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb952165 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265292.635278:0:11857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb952165 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265292.635285:0:11857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb952165 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265292.635292:0:11857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fae8800 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789265292.635297:0:11857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb952165 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265292.635305:0:11857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb952165 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265292.635316:0:11857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1032d00e00) 00010000:00010000:3.0:1789265292.635319:0:11857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265292.635323:0:11857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb952165 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265292.635329:0:11857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb952165 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789265292.635344:0:11857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cf5d8f8a reply state 00000000b77b4f76 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8000/0x27274ba5bb95216c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265292.635351:0:11857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789265292.635459:0:11857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bb07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+10:10248:x1876180397483904:12345-192.168.203.37@tcp:36:lfs.0 Request processed in 1566us (1682us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789265292.635468:0:11857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 37 00010000:00010000:3.0:1789265292.637795:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8000/0x27274ba5bb95216c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265292.637818:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8000/0x27274ba5bb95216c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265292.637826:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8000/0x27274ba5bb95216c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265292.637832:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fae8000 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789265292.637837:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8000/0x27274ba5bb95216c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265292.637844:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8000/0x27274ba5bb95216c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265292.637858:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8a1032d00500) 00010000:00010000:3.0:1789265292.637861:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265292.637865:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8000/0x27274ba5bb95216c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265292.637871:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8000/0x27274ba5bb95216c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265292.718155:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265292.718215:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397484032 00000100:00100000:0.0:1789265292.718226:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397484032 00000100:00100000:0.0:1789265292.718289:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 38 00000100:00100000:0.0:1789265292.718300:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bb06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+9:10256:x1876180397484032:12345-192.168.203.37@tcp:101:lctl.0 00010000:00010000:0.0:1789265292.718621:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265292.718657:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263400/0x27274ba5bb952173 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99efde3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265292.718806:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262c00/0x27274ba5bb95217a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265292.718816:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262c00/0x27274ba5bb95217a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265292.718825:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262c00/0x27274ba5bb95217a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265292.718851:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789265292.718853:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789265292.718879:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262c00/0x27274ba5bb95217a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265292.718896:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263400/0x27274ba5bb952173 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efde3 expref: 11 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265292.718909:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262c00/0x27274ba5bb95217a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efde3 expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265292.718914:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a101b706400) 00010000:00010000:0.0:1789265292.718917:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789265292.718919:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1017262c00, rc 0) 00000100:00100000:0.0:1789265292.718968:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bb06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+10:10256:x1876180397484032:12345-192.168.203.37@tcp:101:lctl.0 Request processed in 671us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265292.718972:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 38 00000100:00100000:2.0:1789265292.784372:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265292.784558:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397484160 00000100:00100000:0.0:1789265292.784592:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397484160 00000100:00100000:0.0:1789265292.784657:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 39 00000100:00100000:0.0:1789265292.784667:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c0d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+10:10262:x1876180397484160:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:0.0:1789265292.784687:0:7934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265292.784707:0:7934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263400/0x27274ba5bb952181 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99efdea expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265292.784769:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263a00/0x27274ba5bb952188 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265292.784783:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263a00/0x27274ba5bb952188 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265292.784794:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263a00/0x27274ba5bb952188 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265292.784807:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262800/0x27274ba5bb95218f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265292.784814:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262800/0x27274ba5bb95218f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265292.784820:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262800/0x27274ba5bb95218f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265292.784919:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263c00/0x27274ba5bb952196 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265292.784927:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263c00/0x27274ba5bb952196 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265292.784933:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263c00/0x27274ba5bb952196 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265292.785505:0:7934:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1789265292.785510:0:7934:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789265292.785586:0:7934:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263c00/0x27274ba5bb952196 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265292.785599:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263a00/0x27274ba5bb952188 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265292.785606:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263a00/0x27274ba5bb952188 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265292.785613:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263a00/0x27274ba5bb952188 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265292.785619:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1017263a00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789265292.785622:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263a00/0x27274ba5bb952188 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265292.785629:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263a00/0x27274ba5bb952188 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265292.785642:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a101b706400) 00010000:00010000:1.0:1789265292.785653:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265292.785658:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263a00/0x27274ba5bb952188 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265292.785663:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263a00/0x27274ba5bb952188 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265292.785678:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262800/0x27274ba5bb95218f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265292.785683:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262800/0x27274ba5bb95218f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265292.785688:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262800/0x27274ba5bb95218f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265292.785693:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1017262800 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789265292.785696:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262800/0x27274ba5bb95218f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265292.785701:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262800/0x27274ba5bb95218f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265292.785866:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8a101b706600) 00010000:00010000:1.0:1789265292.785871:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265292.785875:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262800/0x27274ba5bb95218f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265292.785881:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262800/0x27274ba5bb95218f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265292.785917:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263400/0x27274ba5bb952181 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efdea expref: 12 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265292.785944:0:7934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263c00/0x27274ba5bb952196 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efdea expref: 11 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265292.785951:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a101b706300) 00010000:00010000:1.0:1789265292.785954:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789265292.785956:0:7934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1017263c00, rc 0) 00000100:00100000:1.0:1789265292.786177:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c0d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+11:10262:x1876180397484160:12345-192.168.203.37@tcp:101:bash.0 Request processed in 1495us (1797us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265292.786186:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 39 00000100:00100000:2.0:1789265292.789818:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265292.789903:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397484416 00000100:00100000:3.0:1789265292.789913:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397484416 00000100:00100000:3.0:1789265292.789990:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 40 00000100:00100000:3.0:1789265292.790000:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c0d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+11:10262:x1876180397484416:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:3.0:1789265292.790407:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265292.790430:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8000/0x27274ba5bb95219d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99efdf1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265292.790705:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb9521a4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265292.790720:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb9521a4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265292.790732:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb9521a4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265292.790779:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb9521ab lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265292.790787:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb9521ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265292.790794:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb9521ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789265292.791742:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1789265292.791911:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb9521b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265292.791923:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb9521b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265292.791933:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb9521b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265292.792274:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb9521a4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265292.792293:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb9521a4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265292.792362:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb9521a4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265292.792370:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fae8800 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789265292.792375:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb9521a4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265292.792383:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb9521a4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265292.792395:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a101b706300) 00010000:00010000:3.0:1789265292.792398:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265292.792403:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb9521a4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265292.792408:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb9521a4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789265292.792421:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ac22162c reply state 00000000f150fe71 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb9521ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265292.792429:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789265292.792535:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8000/0x27274ba5bb95219d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efdf1 expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265292.792551:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb9521b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efdf1 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265292.792570:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a1032d00e00) 00010000:00010000:3.0:1789265292.792573:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789265292.792575:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fae9a00, rc 0) 00000100:00100000:3.0:1789265292.792704:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c0d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+14:10262:x1876180397484416:12345-192.168.203.37@tcp:101:bash.0 Request processed in 2703us (2891us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1789265292.792713:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 40 00000100:00100000:0.0:1789265292.799858:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00010000:00010000:3.0:1789265292.800036:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb9521ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265292.800049:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb9521ab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265292.800057:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb9521ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265292.800064:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fae8e00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789265292.800069:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb9521ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265292.800093:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb9521ab lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265292.800110:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8a1032d00500) 00010000:00010000:3.0:1789265292.800113:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265292.800117:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb9521ab lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265292.800124:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb9521ab lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265292.800325:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397484544 00000100:00100000:2.0:1789265292.800334:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397484544 00000100:00100000:2.0:1789265292.800373:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 20 00000100:00100000:2.0:1789265292.800381:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10031fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2347:x1876180397484544:12345-192.168.203.37@tcp:8:bash.0 00010000:00080000:2.0:1789265292.800409:0:8856:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 4b820fcb-1bab-4b78-bfa4-355c22a09cf8@192.168.203.37@tcp t0 exp 0000000000000000 cur 338 last 0 00000020:00000080:2.0:1789265292.800435:0:8856:0:(genops.c:1385:class_connect()) connect: client 4b820fcb-1bab-4b78-bfa4-355c22a09cf8, cookie 0x27274ba5bb9521c0 00002000:00100000:2.0:1789265292.800447:0:8856:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4b820fcb-1bab-4b78-bfa4-355c22a09cf8/ffff8a10052c9000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113969 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789265292.800468:0:8856:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789265292.800667:0:8856:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789265292.800694:0:8856:0:(import.c:65:import_set_state_nolock()) ffff8a10052cc800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789265292.800764:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10031fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:2347:x1876180397484544:12345-192.168.203.37@tcp:8:bash.0 Request processed in 382us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265292.800772:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 20 00000100:00100000:2.0:1789265292.814278:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265292.814465:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397484672 00000100:00100000:3.0:1789265292.814474:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397484672 00000100:00100000:3.0:1789265292.814535:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 21 00000100:00100000:3.0:1789265292.814543:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c0d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:0:x1876180397484672:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:3.0:1789265292.814559:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265292.814581:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0b070fb/0x27274ba5bb9521c7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99efdf8 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789265292.814659:0:6685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789265292.814678:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=338s v=(0 0) 00010000:00010000:3.0:1789265292.814682:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265292.814691:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0b070fb/0x27274ba5bb9521c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efdf8 expref: 7 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265292.814710:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c0b070fb/0x27274ba5bb9521c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efdf8 expref: 7 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265292.814723:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fae8000, rc 0) 00000100:00100000:3.0:1789265292.814776:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c0d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+7:0:x1876180397484672:12345-192.168.203.37@tcp:101:bash.0 Request processed in 234us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265292.814783:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 21 00000100:00080000:1.0:1789265292.814832:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789265292.827895:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265292.828432:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397484800 00000100:00100000:3.0:1789265292.828443:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397484800 00000100:00100000:3.0:1789265292.828494:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 22 00000100:00100000:3.0:1789265292.828504:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10037b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+7:10262:x1876180397484800:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:3.0:1789265292.828537:0:8856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265292.828555:0:8856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c55b5878/0x27274ba5bb9521ce lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99efdff expref: -99 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265292.828614:0:8856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c0b070fb/0x27274ba5bb9521c7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efdf8 expref: 8 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265292.828624:0:8856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265292.828628:0:8856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265292.828633:0:8856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c55b5878/0x27274ba5bb9521ce lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efdff expref: 8 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265292.828671:0:8856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c0b070fb/0x27274ba5bb9521c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efdf8 expref: 8 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265292.828687:0:8856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c0b070fb/0x27274ba5bb9521c7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efdf8 expref: 8 pid: 6685 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265292.828702:0:8856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103bb04700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8856:1876180414295552:192.168.203.37@tcp:104: 00000100:00100000:3.0:1789265292.828789:0:8856:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103bb47180 going to sleep for 11 seconds 00000100:00100000:3.0:1789265292.835140:0:8856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103bb04700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8856:1876180414295552:192.168.203.37@tcp:104: 00010000:00010000:3.0:1789265292.835190:0:8856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c55b5878/0x27274ba5bb9521ce lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efdff expref: 8 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265292.835212:0:8856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fae8e00, rc 0) 00000100:00100000:3.0:1789265292.835294:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10037b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+8:10262:x1876180397484800:12345-192.168.203.37@tcp:101:bash.0 Request processed in 6791us (7710us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265292.835303:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 22 00000100:00100000:2.0:1789265292.835630:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265292.835946:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397484928 00000100:00100000:1.0:1789265292.835964:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397484928 00010000:00010000:1.0:1789265292.836000:0:8490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c0b070fb/0x27274ba5bb9521c7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efdf8 expref: 8 pid: 6685 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265292.836041:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 35 00000100:00100000:1.0:1789265292.836051:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10037b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+8:2350:x1876180397484928:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265292.836064:0:8490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265292.836116:0:8490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c0b070fb/0x27274ba5bb9521c7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efdf8 expref: 8 pid: 6685 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265292.836132:0:8490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c0b070fb/0x27274ba5bb9521c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efdf8 expref: 8 pid: 6685 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265292.836157:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0b070fb/0x27274ba5bb9521c7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efdf8 expref: 8 pid: 6685 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265292.836187:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265292.836191:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265292.836199:0:8490:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c55b5878/0x27274ba5bb9521ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efdff expref: 7 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265292.836208:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c55b5878/0x27274ba5bb9521ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efdff expref: 7 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265292.836239:0:8490:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c55b5878/0x27274ba5bb9521ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efdff expref: 7 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265292.836252:0:8490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1009071500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8490:1876180414295680:192.168.203.37@tcp:105: 00000100:00100000:1.0:1789265292.836311:0:8490:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1002cd7600 going to sleep for 11 seconds 00000100:00100000:1.0:1789265292.838999:0:8490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1009071500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8490:1876180414295680:192.168.203.37@tcp:105: 00010000:00010000:1.0:1789265292.839024:0:8490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265292.839102:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10037b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+7:2350:x1876180397484928:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 3026us (3446us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265292.839112:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 35 00000100:00100000:3.0:1789265292.845344:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265292.850748:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397485184 00000100:00100000:2.0:1789265292.850763:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397485184 00000100:00100000:2.0:1789265292.851446:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 6 00000100:00100000:2.0:1789265292.851460:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bb04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+13:10262:x1876180397485184:12345-192.168.203.37@tcp:35:bash.0 00000001:00080000:2.0:1789265292.851739:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967312 00000100:00100000:2.0:1789265292.851907:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bb04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+15:10262:x1876180397485184:12345-192.168.203.37@tcp:35:bash.0 Request processed in 450us (6570us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1789265292.851915:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 6 00000020:00080000:2.0:1789265292.851920:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789265292.951696:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265292.951826:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397485440 00000100:00100000:3.0:1789265292.951836:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397485440 00000100:00100000:3.0:1789265292.951946:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 41 00000100:00100000:3.0:1789265292.951958:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10031ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+15:10272:x1876180397485440:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:3.0:1789265292.951980:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265292.952001:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb9521d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99efe06 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265292.952198:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789265292.952316:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb9521d5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe06 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265292.952331:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a101b706400) 00010000:00010000:3.0:1789265292.952334:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789265292.952338:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb9521d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe06 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265292.952353:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fae8800, rc 0) 00000100:00100000:3.0:1789265292.952402:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10031ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+16:10272:x1876180397485440:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 448us (717us total) trans 4294967314 rc 301/301 00000100:00100000:3.0:1789265292.952407:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 41 00000100:00100000:3.0:1789265292.959486:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265292.959727:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397485696 00000100:00100000:1.0:1789265292.959736:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397485696 00000100:00100000:1.0:1789265292.959792:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 7 00000100:00100000:1.0:1789265292.959803:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bb05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+16:10272:x1876180397485696:12345-192.168.203.37@tcp:35:lfs.0 00000100:00100000:1.0:1789265292.960041:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bb05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+17:10272:x1876180397485696:12345-192.168.203.37@tcp:35:lfs.0 Request processed in 239us (563us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1789265292.960059:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 7 00000100:00100000:0.0:1789265293.058912:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265293.059108:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397485824 00000100:00100000:1.0:1789265293.059118:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397485824 00000100:00100000:1.0:1789265293.059188:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 42 00000100:00100000:1.0:1789265293.059198:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10031ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+17:10278:x1876180397485824:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:1.0:1789265293.059222:0:7934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265293.059243:0:7934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597000/0x27274ba5bb9521e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99efe0d expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265293.059308:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb9521ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265293.059321:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb9521ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265293.059331:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb9521ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265293.059366:0:7934:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1789265293.059369:0:7934:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789265293.059386:0:7934:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb9521ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265293.059411:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597000/0x27274ba5bb9521e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe0d expref: 19 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265293.059429:0:7934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb9521ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe0d expref: 18 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265293.059468:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a101b706300) 00010000:00010000:1.0:1789265293.059471:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789265293.059474:0:7934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a101b597200, rc 0) 00000100:00100000:1.0:1789265293.059547:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10031ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+18:10278:x1876180397485824:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 350us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265293.059554:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 42 00000100:00100000:0.0:1789265293.065385:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265293.065555:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397486080 00000100:00100000:3.0:1789265293.065587:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397486080 00000100:00100000:3.0:1789265293.065647:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 43 00000100:00100000:3.0:1789265293.065658:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10031fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+18:10278:x1876180397486080:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:3.0:1789265293.065679:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265293.065701:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb9521f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99efe14 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265293.065804:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8200/0x27274ba5bb9521f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265293.065819:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8200/0x27274ba5bb9521f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265293.065831:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8200/0x27274ba5bb9521f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265293.065844:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789265293.065979:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb9521f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe14 expref: 21 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265293.065999:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8200/0x27274ba5bb9521f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe14 expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265293.066008:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a1032d00e00) 00010000:00010000:3.0:1789265293.066011:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789265293.066014:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fae8200, rc 0) 00000100:00100000:3.0:1789265293.066797:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10031fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+20:10278:x1876180397486080:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 1136us (1417us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1789265293.066807:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 43 00000100:00100000:3.0:1789265293.073031:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265293.073111:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265293.073208:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397486336 00000100:00100000:0.0:1789265293.073217:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397486336 00000100:00100000:0.0:1789265293.073279:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 44 00000100:00100000:0.0:1789265293.073288:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bb06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+20:10278:x1876180397486336:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:0.0:1789265293.073311:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265293.073331:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263400/0x27274ba5bb952206 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99efe1b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265293.073423:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262800/0x27274ba5bb95220d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265293.073448:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262800/0x27274ba5bb95220d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265293.073461:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262800/0x27274ba5bb95220d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265293.073472:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789265293.073608:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263400/0x27274ba5bb952206 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe1b expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265293.073626:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262800/0x27274ba5bb95220d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe1b expref: 22 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265293.073647:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a1032d00e00) 00010000:00010000:0.0:1789265293.073649:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789265293.073652:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1017262800, rc 0) 00000100:00100000:0.0:1789265293.073712:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bb06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+22:10278:x1876180397486336:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 426us (694us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1789265293.073719:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 44 00000100:00100000:1.0:1789265293.074245:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397486464 00000100:00100000:1.0:1789265293.074252:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397486464 00000100:00100000:1.0:1789265293.074300:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 2 00000100:00100000:1.0:1789265293.074309:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bb07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+22:2350:x1876180397486464:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265293.074320:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265293.074336:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8200/0x27274ba5bb9521f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe14 expref: 22 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265293.074349:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a1032d00e00) 00010000:00010000:1.0:1789265293.074353:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265293.074388:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bb07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+21:2350:x1876180397486464:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 80us (1277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265293.074395:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 2 00000100:00100000:3.0:1789265293.078135:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265293.078249:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397486592 00000100:00100000:2.0:1789265293.078259:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397486592 00000100:00100000:2.0:1789265293.078315:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 23 00000100:00100000:2.0:1789265293.078325:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bb05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+7:2351:x1876180397486592:12345-192.168.203.37@tcp:1:lfs.0 00010000:00010000:2.0:1789265293.078371:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb5911a5/0x27274ba5bb95221b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265293.078392:0:6685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c55b5878/0x27274ba5bb9521ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efdff expref: 7 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265293.078401:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265293.078406:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789265293.078410:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb5911a5/0x27274ba5bb95221b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265293.078459:0:6685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c55b5878/0x27274ba5bb9521ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efdff expref: 7 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265293.078476:0:6685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c55b5878/0x27274ba5bb9521ce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efdff expref: 7 pid: 8856 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265293.078490:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10037b2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6685:1876180414295808:192.168.203.37@tcp:104: 00000100:00100000:2.0:1789265293.078582:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10086f2000 going to sleep for 11 seconds 00000100:00100000:2.0:1789265293.083761:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10037b2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6685:1876180414295808:192.168.203.37@tcp:104: 00010000:00010000:2.0:1789265293.083792:0:6685:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fb5911a5/0x27274ba5bb95221b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265293.085976:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265293.086210:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397486720 00000100:00100000:0.0:1789265293.086221:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397486720 00002000:00100000:0.0:1789265293.086269:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff8a103bb06d80 x1876180397486720/t0(0) o4->4b820fcb-1bab-4b78-bfa4-355c22a09cf8@192.168.203.37@tcp:619/0 lens 504/0 e 0 to 0 dl 1789265304 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789265293.086280:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a103bb06d80 with x1876180397486720 ext(0->12) 00010000:00010000:0.0:1789265293.086290:0:6688:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c55b5878/0x27274ba5bb9521ce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efdff expref: 8 pid: 8856 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265293.086309:0:6688:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c55b5878/0x27274ba5bb9521ce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efdff expref: 8 pid: 8856 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789265293.086317:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8a103bb06d80 00000100:00100000:0.0:1789265293.086346:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 0 00000100:00100000:0.0:1789265293.086355:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bb06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+8:2351:x1876180397486720:12345-192.168.203.37@tcp:4:lfs.0 00000001:00100000:3.0:1789265293.128012:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4b820fcb-1bab-4b78-bfa4-355c22a09cf8 00000100:00100000:0.0:1789265293.128980:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bb06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+9:2351:x1876180397486720:12345-192.168.203.37@tcp:4:lfs.0 Request processed in 42621us (43007us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789265293.128994:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 0 00002000:00100000:0.0:1789265293.129007:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff8a103bb06d80 x1876180397486720/t4294967299(0) o4->4b820fcb-1bab-4b78-bfa4-355c22a09cf8@192.168.203.37@tcp:619/0 lens 504/448 e 0 to 0 dl 1789265304 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789265293.129028:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a103bb06d80 with x1876180397486720 ext(0->12) 00010000:00010000:0.0:1789265293.129039:0:6688:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c55b5878/0x27274ba5bb9521ce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efdff expref: 9 pid: 8856 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265293.129062:0:6688:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c55b5878/0x27274ba5bb9521ce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efdff expref: 9 pid: 8856 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789265293.129071:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8a103bb06d80 00000100:00100000:0.0:1789265293.134832:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265293.134945:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397486848 00000100:00100000:2.0:1789265293.134956:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397486848 00010000:00010000:2.0:1789265293.134999:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c55b5878/0x27274ba5bb9521ce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efdff expref: 9 pid: 8856 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265293.135110:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 36 00000100:00100000:2.0:1789265293.135120:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10031fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+9:2348:x1876180397486848:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265293.135134:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789265293.135152:0:5827:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789265293.135156:0:5827:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1789265293 00002000:00010000:2.0:1789265293.135158:0:5827:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1789265293 00002000:00010000:2.0:1789265293.135160:0:5827:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1789265293 00010000:00010000:2.0:1789265293.135178:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c55b5878/0x27274ba5bb9521ce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efdff expref: 9 pid: 8856 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265293.135196:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c55b5878/0x27274ba5bb9521ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efdff expref: 9 pid: 8856 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265293.135222:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c55b5878/0x27274ba5bb9521ce lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efdff expref: 9 pid: 8856 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265293.135250:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789265293.135266:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789265293.135272:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fb5911a5/0x27274ba5bb95221b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265293.135282:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb5911a5/0x27274ba5bb95221b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265293.135311:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265293.135372:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10031fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+8:2348:x1876180397486848:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 253us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265293.135380:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 36 00010000:00010000:3.0:1789265293.135457:0:6685:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fb5911a5/0x27274ba5bb95221b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265293.135467:0:6685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb5911a5/0x27274ba5bb95221b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265293.135491:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb5911a5/0x27274ba5bb95221b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265293.135499:0:6685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb5911a5/0x27274ba5bb95221b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265293.135507:0:6685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb5911a5/0x27274ba5bb95221b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265293.135513:0:6685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad7400 already unused, calling callback (ffffffffc1581350) 00010000:00010000:3.0:1789265293.135517:0:6685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb5911a5/0x27274ba5bb95221b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265293.135527:0:6685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb5911a5/0x27274ba5bb95221b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265293.135568:0:6685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb5911a5/0x27274ba5bb95221b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265293.135577:0:6685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb5911a5/0x27274ba5bb95221b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265293.137908:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bb05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+7:2351:x1876180397486592:12345-192.168.203.37@tcp:1:lfs.0 Request processed in 59576us (59774us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265293.137921:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 23 00000100:00100000:0.0:1789265293.140394:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265293.140792:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397487104 00000100:00100000:1.0:1789265293.140803:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397487104 00000100:00100000:1.0:1789265293.140863:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 8 00000100:00100000:1.0:1789265293.140873:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10031ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+21:10278:x1876180397487104:12345-192.168.203.37@tcp:35:lfs.0 00000004:00010000:1.0:1789265293.140929:0:5844:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262800/0x27274ba5bb95220d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe1b expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789265293.141850:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:1.0:1789265293.141900:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:1.0:1789265293.142816:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00010000:00010000:1.0:1789265293.142877:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597000/0x27274ba5bb952222 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265293.142895:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb9521b2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efdf1 expref: 25 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265293.142904:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597000/0x27274ba5bb952222 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265293.142941:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb9521b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efdf1 expref: 25 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265293.142958:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb9521b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efdf1 expref: 25 pid: 5841 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265293.142971:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1009071500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5844:1876180414295936:192.168.203.37@tcp:104: 00000100:00100000:1.0:1789265293.143095:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1002cd7600 going to sleep for 11 seconds 00000100:00100000:0.0:1789265293.146465:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265293.146645:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397487232 00000100:00100000:2.0:1789265293.146656:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397487232 00010000:00010000:2.0:1789265293.146701:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb9521b2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efdf1 expref: 26 pid: 5841 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265293.146713:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1009071500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5844:1876180414295936:192.168.203.37@tcp:104: 00010000:00010000:1.0:1789265293.146740:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597000/0x27274ba5bb952222 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265293.146745:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 37 00000100:00100000:2.0:1789265293.146761:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10031fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+26:2350:x1876180397487232:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265293.146776:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265293.146783:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb9521b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efdf1 expref: 26 pid: 5841 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265293.146798:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb9521b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efdf1 expref: 26 pid: 5841 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265293.146822:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb9521b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efdf1 expref: 26 pid: 5841 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265293.146858:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a1032d00e00) 00010000:00010000:2.0:1789265293.146863:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597000/0x27274ba5bb952222 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265293.146872:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597000/0x27274ba5bb952222 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265293.146879:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597000/0x27274ba5bb952222 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265293.146908:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265293.146961:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10031fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+25:2350:x1876180397487232:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 202us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265293.146968:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 37 00010000:00010000:1.0:1789265293.147398:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597000/0x27274ba5bb952222 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265293.147407:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597000/0x27274ba5bb952222 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789265293.147523:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000001:00080000:1.0:1789265293.147931:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:1.0:1789265293.148307:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1009071500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5844:1876180414296064:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789265293.148361:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265293.148391:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1002cd7180 going to sleep for 11 seconds 00000100:00100000:2.0:1789265293.148419:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414296064 00000100:00100000:2.0:1789265293.148427:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414296064 00000100:00100000:2.0:1789265293.148733:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789265293.148744:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1009070e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1876180414296064:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:1.0:1789265293.148802:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789265293.148829:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1009070e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1876180414296064:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 86us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265293.148838:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789265293.148851:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1009071500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5844:1876180414296064:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789265293.153886:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:1.0:1789265293.153981:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1009071500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5844:1876180414296192:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789265293.154860:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265293.154902:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1002cd7600 going to sleep for 11 seconds 00000100:00100000:3.0:1789265293.155145:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414296192 00000100:00100000:3.0:1789265293.155153:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414296192 00000100:00100000:3.0:1789265293.155212:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789265293.155222:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1009072680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5844:x1876180414296192:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789265293.155456:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1009072680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5844:x1876180414296192:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 235us (597us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1789265293.155464:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789265293.155541:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1009071500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5844:1876180414296192:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789265293.155810:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:1.0:1789265293.155851:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597000/0x27274ba5bb952222 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265293.155862:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597000/0x27274ba5bb952222 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265293.155870:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597000/0x27274ba5bb952222 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265293.155877:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b597000 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789265293.155881:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597000/0x27274ba5bb952222 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265293.155889:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597000/0x27274ba5bb952222 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265293.155915:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a1032d00e00) 00010000:00010000:1.0:1789265293.155919:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789265293.155923:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597000/0x27274ba5bb952222 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265293.155930:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597000/0x27274ba5bb952222 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789265293.157038:0:5844:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789265293.157311:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1789265293.157323:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 338962247134ns, next at 339962244390ns, rc = 0 00000001:00080000:0.0:1789265293.157331:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:0.0:1789265293.157374:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a1032d00e00) 00010000:00010000:0.0:1789265293.157378:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789265293.157386:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262800/0x27274ba5bb95220d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe1b expref: 29 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265293.157518:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10031ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+28:10278:x1876180397487104:12345-192.168.203.37@tcp:35:lfs.0 Request processed in 16645us (17130us total) trans 4294967326 rc 0/0 00000100:00100000:0.0:1789265293.157534:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 8 00000020:00080000:0.0:1789265293.157539:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789265293.173416:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265293.173547:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397487360 00000100:00100000:3.0:1789265293.173556:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397487360 00000100:00100000:3.0:1789265293.173664:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 45 00000100:00100000:3.0:1789265293.173676:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10031fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+28:10278:x1876180397487360:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:3.0:1789265293.173698:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265293.173721:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb952229 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99efe22 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265293.173798:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb952229 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe22 expref: 29 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265293.173836:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb952229 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe22 expref: 29 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265293.173873:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a1032d00500) 00010000:00010000:3.0:1789265293.173876:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789265293.173880:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fae8800, rc 0) 00000100:00100000:3.0:1789265293.173939:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10031fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+29:10278:x1876180397487360:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 265us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265293.173946:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 45 00000100:00100000:3.0:1789265293.180368:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265293.186404:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397487616 00000100:00100000:0.0:1789265293.186509:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397487616 00000100:00100000:0.0:1789265293.186974:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 9 00000100:00100000:0.0:1789265293.186992:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1010a40050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+29:10278:x1876180397487616:12345-192.168.203.37@tcp:35:lfs.0 00000100:00100000:0.0:1789265293.188292:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1010a40050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+30:10278:x1876180397487616:12345-192.168.203.37@tcp:35:lfs.0 Request processed in 1303us (7927us total) trans 4294967327 rc 0/0 00000100:00100000:0.0:1789265293.188304:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 9 00000100:00100000:0.0:1789265293.309255:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265293.310965:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397487872 00000100:00100000:3.0:1789265293.310993:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397487872 00000100:00100000:3.0:1789265293.311185:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 46 00000100:00100000:3.0:1789265293.311213:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10031ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+30:10288:x1876180397487872:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:3.0:1789265293.311253:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265293.311287:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb952230 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99efe29 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265293.311397:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789265293.311510:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb952230 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe29 expref: 32 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265293.311525:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a101b706400) 00010000:00010000:3.0:1789265293.311529:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789265293.311534:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb952230 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe29 expref: 32 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265293.311567:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fae9200, rc 0) 00000100:00100000:3.0:1789265293.311637:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10031ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+31:10288:x1876180397487872:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 443us (2408us total) trans 4294967328 rc 301/301 00000100:00100000:3.0:1789265293.311645:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 46 00000100:00100000:3.0:1789265293.315382:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265293.315480:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397488000 00000100:00100000:2.0:1789265293.315490:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397488000 00000100:00100000:2.0:1789265293.315543:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 47 00000100:00100000:2.0:1789265293.315553:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bb04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+31:10288:x1876180397488000:12345-192.168.203.37@tcp:34:lfs.0 00010000:00010000:2.0:1789265293.315766:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb95223e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265293.315805:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb95223e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265293.315819:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb95223e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265293.315835:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7e00/0x27274ba5bb952245 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265293.315842:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7e00/0x27274ba5bb952245 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265293.315849:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7e00/0x27274ba5bb952245 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265293.315922:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb95224c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265293.315927:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb95224c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265293.315931:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb95224c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789265293.315973:0:7934:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb95224c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265293.315985:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb95223e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265293.315992:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb95223e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265293.316009:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb95223e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265293.316014:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad6c00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789265293.316019:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb95223e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265293.316026:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb95223e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265293.316038:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a101b706300) 00010000:00010000:2.0:1789265293.316041:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265293.316044:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb95223e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265293.316050:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb95223e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265293.316062:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7e00/0x27274ba5bb952245 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265293.316068:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7e00/0x27274ba5bb952245 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265293.316298:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7e00/0x27274ba5bb952245 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265293.316305:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad7e00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789265293.316308:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7e00/0x27274ba5bb952245 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265293.316325:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7e00/0x27274ba5bb952245 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265293.316332:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8a1012931b00) 00010000:00010000:2.0:1789265293.316333:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265293.316335:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7e00/0x27274ba5bb952245 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265293.316339:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7e00/0x27274ba5bb952245 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265293.316349:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb95224c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265293.316353:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb95224c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265293.316356:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb95224c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265293.316359:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad6600 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789265293.316361:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb95224c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265293.316364:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb95224c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265293.316367:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a1032d00500) 00010000:00010000:2.0:1789265293.316369:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265293.316370:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb95224c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265293.316379:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb95224c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265293.316474:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bb04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+31:10288:x1876180397488000:12345-192.168.203.37@tcp:34:lfs.0 Request processed in 921us (1099us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265293.316479:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 47 00000100:00100000:1.0:1789265293.318611:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265293.318681:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397488256 00000100:00100000:2.0:1789265293.318689:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397488256 00000100:00100000:2.0:1789265293.318741:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 10 00000100:00100000:2.0:1789265293.318751:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1009070700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+31:10288:x1876180397488256:12345-192.168.203.37@tcp:35:lfs.0 00000100:00100000:2.0:1789265293.318953:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1009070700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+32:10288:x1876180397488256:12345-192.168.203.37@tcp:35:lfs.0 Request processed in 203us (358us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1789265293.318961:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 10 00000100:00100000:0.0:1789265293.347967:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265293.348146:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397488512 00000100:00100000:3.0:1789265293.348155:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397488512 00000100:00100000:3.0:1789265293.348225:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 48 00000100:00100000:3.0:1789265293.348236:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10031fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+32:10291:x1876180397488512:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:3.0:1789265293.348258:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265293.348279:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb952253 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99efe30 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265293.348352:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8600/0x27274ba5bb95225a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265293.348367:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8600/0x27274ba5bb95225a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265293.348380:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8600/0x27274ba5bb95225a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265293.348395:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9000/0x27274ba5bb952261 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265293.348403:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9000/0x27274ba5bb952261 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265293.348428:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9000/0x27274ba5bb952261 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265293.348536:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9c00/0x27274ba5bb952268 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265293.348544:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9c00/0x27274ba5bb952268 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265293.348551:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9c00/0x27274ba5bb952268 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265293.348560:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789265293.348714:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8600/0x27274ba5bb95225a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265293.348723:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8600/0x27274ba5bb95225a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265293.348730:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8600/0x27274ba5bb95225a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265293.348736:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fae8600 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789265293.348740:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8600/0x27274ba5bb95225a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265293.348747:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8600/0x27274ba5bb95225a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265293.348759:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a101b706300) 00010000:00010000:3.0:1789265293.348762:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265293.348772:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8600/0x27274ba5bb95225a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265293.348779:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8600/0x27274ba5bb95225a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265293.348791:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9000/0x27274ba5bb952261 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265293.348797:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9000/0x27274ba5bb952261 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265293.348803:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9000/0x27274ba5bb952261 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265293.348808:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fae9000 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789265293.348811:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9000/0x27274ba5bb952261 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265293.348816:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9000/0x27274ba5bb952261 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265293.348824:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8a1032d00600) 00010000:00010000:3.0:1789265293.348827:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265293.348829:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9000/0x27274ba5bb952261 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265293.348835:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9000/0x27274ba5bb952261 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265293.348874:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb952253 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe30 expref: 35 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265293.348903:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9c00/0x27274ba5bb952268 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe30 expref: 34 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265293.348911:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a1032d00500) 00010000:00010000:3.0:1789265293.348913:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789265293.348915:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fae9c00, rc 0) 00000100:00100000:3.0:1789265293.349290:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10031fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+34:10291:x1876180397488512:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 1054us (1332us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1789265293.349298:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 48 00000100:00100000:3.0:1789265293.356067:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265293.356192:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397488640 00000100:00100000:0.0:1789265293.356201:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397488640 00000100:00100000:0.0:1789265293.356261:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 49 00000100:00100000:0.0:1789265293.356271:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bb05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+34:10291:x1876180397488640:12345-192.168.203.37@tcp:54:lfs.0 00010000:00010000:0.0:1789265293.356336:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262600/0x27274ba5bb952276 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265293.356353:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262600/0x27274ba5bb952276 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265293.356364:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262600/0x27274ba5bb952276 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265293.356391:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262600/0x27274ba5bb952276 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265293.356398:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262600/0x27274ba5bb952276 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265293.356405:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262600/0x27274ba5bb952276 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265293.356426:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1017262600 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789265293.356430:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262600/0x27274ba5bb952276 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265293.356438:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262600/0x27274ba5bb952276 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265293.356450:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a1032d00500) 00010000:00010000:0.0:1789265293.356453:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789265293.356457:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262600/0x27274ba5bb952276 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265293.356464:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262600/0x27274ba5bb952276 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265293.356544:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bb05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+34:10291:x1876180397488640:12345-192.168.203.37@tcp:54:lfs.0 Request processed in 274us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265293.356552:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 49 00000100:00100000:1.0:1789265293.364932:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265293.368185:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397488896 00000100:00100000:2.0:1789265293.368201:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397488896 00000100:00100000:2.0:1789265293.368278:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 11 00000100:00100000:2.0:1789265293.368289:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1009070000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+34:10291:x1876180397488896:12345-192.168.203.37@tcp:35:lfs.0 00000100:00100000:2.0:1789265293.368540:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1009070000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+35:10291:x1876180397488896:12345-192.168.203.37@tcp:35:lfs.0 Request processed in 251us (3617us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1789265293.368548:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 11 00010000:00010000:2.0:1789265293.618317:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265293.676012:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265293.676280:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397489152 00000100:00100000:2.0:1789265293.676290:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397489152 00000100:00100000:2.0:1789265293.676350:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 50 00000100:00100000:2.0:1789265293.676360:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1009071f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+35:10322:x1876180397489152:12345-192.168.203.37@tcp:101:cat.0 00010000:00010000:2.0:1789265293.676397:0:7934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265293.676430:0:7934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb95227d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99efe37 expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265293.676534:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7e00/0x27274ba5bb952284 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265293.676559:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7e00/0x27274ba5bb952284 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265293.676573:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7e00/0x27274ba5bb952284 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265293.676584:0:7934:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789265293.676716:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb95227d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe37 expref: 38 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265293.676735:0:7934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7e00/0x27274ba5bb952284 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe37 expref: 37 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265293.676743:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a1032d00500) 00010000:00010000:2.0:1789265293.676745:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789265293.676748:0:7934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fad7e00, rc 0) 00000100:00100000:2.0:1789265293.676805:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1009071f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+37:10322:x1876180397489152:12345-192.168.203.37@tcp:101:cat.0 Request processed in 447us (803us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1789265293.676812:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 50 00000100:00100000:3.0:1789265293.680020:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265293.684627:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397489280 00000100:00100000:1.0:1789265293.684643:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397489280 00000100:00100000:1.0:1789265293.684833:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 3 00000100:00100000:1.0:1789265293.684845:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10118e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+37:2351:x1876180397489280:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265293.684862:0:8490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265293.684886:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7e00/0x27274ba5bb952284 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe37 expref: 37 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265293.684906:0:8490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a1032d00500) 00010000:00010000:1.0:1789265293.684911:0:8490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265293.685016:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10118e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+36:2351:x1876180397489280:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 172us (5003us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265293.685023:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 3 00000100:00100000:0.0:1789265293.686023:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265293.686121:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397489536 00000100:00100000:2.0:1789265293.686128:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397489536 00000100:00100000:2.0:1789265293.686177:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 12 00000100:00100000:2.0:1789265293.686200:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10031fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+36:10322:x1876180397489536:12345-192.168.203.37@tcp:35:cat.0 00000100:00100000:2.0:1789265293.686411:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10031fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+37:10322:x1876180397489536:12345-192.168.203.37@tcp:35:cat.0 Request processed in 213us (392us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1789265293.686420:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 12 00000100:00100000:3.0:1789265293.744793:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265293.745519:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397489792 00000100:00100000:0.0:1789265293.745531:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397489792 00000100:00100000:0.0:1789265293.745600:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 51 00000100:00100000:0.0:1789265293.745611:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bb07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+37:10328:x1876180397489792:12345-192.168.203.37@tcp:101:dd.0 00010000:00010000:0.0:1789265293.745634:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265293.745638:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789265293.745663:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb9521ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe0d expref: 37 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265293.745702:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a101b706300) 00010000:00010000:0.0:1789265293.745708:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789265293.745724:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262200/0x27274ba5bb952292 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99efe3e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265293.745839:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262600/0x27274ba5bb952299 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265293.745853:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9c00/0x27274ba5bb952268 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe30 expref: 37 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265293.745861:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262600/0x27274ba5bb952299 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265293.745896:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9c00/0x27274ba5bb952268 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe30 expref: 37 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265293.745912:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9c00/0x27274ba5bb952268 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe30 expref: 37 pid: 5840 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265293.745926:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10031fce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1876180414296320:192.168.203.37@tcp:104: 00000100:00100000:0.0:1789265293.746035:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1008f93540 going to sleep for 11 seconds 00000100:00100000:0.0:1789265293.753540:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10031fce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1876180414296320:192.168.203.37@tcp:104: 00010000:00010000:0.0:1789265293.753573:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262600/0x27274ba5bb952299 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265293.757038:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265293.757286:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397489920 00000100:00100000:2.0:1789265293.757304:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397489920 00010000:00010000:2.0:1789265293.757342:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9c00/0x27274ba5bb952268 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe30 expref: 38 pid: 5840 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265293.757375:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 38 00000100:00100000:2.0:1789265293.757383:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103fa65180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+38:2351:x1876180397489920:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265293.757396:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265293.757402:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9c00/0x27274ba5bb952268 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe30 expref: 38 pid: 5840 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265293.757418:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9c00/0x27274ba5bb952268 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe30 expref: 38 pid: 5840 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265293.757448:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9c00/0x27274ba5bb952268 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe30 expref: 38 pid: 5840 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265293.757466:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a1032d00500) 00010000:00010000:2.0:1789265293.757471:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262600/0x27274ba5bb952299 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265293.757478:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262600/0x27274ba5bb952299 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265293.757502:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262600/0x27274ba5bb952299 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265293.757527:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265293.757581:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103fa65180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+37:2351:x1876180397489920:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 198us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265293.757588:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 38 00010000:00010000:0.0:1789265293.758760:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262600/0x27274ba5bb952299 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265293.758783:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262600/0x27274ba5bb952299 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265293.758803:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789265293.758974:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262200/0x27274ba5bb952292 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe3e expref: 38 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265293.758993:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262600/0x27274ba5bb952299 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe3e expref: 37 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265293.759002:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a1032d00500) 00010000:00010000:0.0:1789265293.759004:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789265293.759007:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1017262600, rc 0) 00000100:00100000:0.0:1789265293.759066:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bb07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+37:10328:x1876180397489792:12345-192.168.203.37@tcp:101:dd.0 Request processed in 13457us (14283us total) trans 4294967334 rc 0/0 00000100:00100000:0.0:1789265293.759093:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 51 00000100:00100000:1.0:1789265293.768485:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265293.768749:0:11857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397490176 00000100:00100000:3.0:1789265293.768759:0:11857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397490176 00000100:00100000:3.0:1789265293.768821:0:11857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 52 00000100:00100000:3.0:1789265293.768831:0:11857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1009070a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+37:10328:x1876180397490176:12345-192.168.203.37@tcp:36:dd.0 00010000:00010000:3.0:1789265293.769102:0:11857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb9522a7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265293.769118:0:11857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb9522a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265293.769129:0:11857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb9522a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789265293.769184:0:11857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967335 00000004:00010000:3.0:1789265293.769222:0:11857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007b0f4a1e reply state 0000000032a3328a transno 4294967336 ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb9522a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265293.769230:0:11857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789265293.769531:0:11857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1009070a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+40:10328:x1876180397490176:12345-192.168.203.37@tcp:36:dd.0 Request processed in 700us (1053us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1789265293.769539:0:11857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 52 00000020:00080000:3.0:1789265293.769544:0:11857:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789265293.773770:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb9522a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265293.773787:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb9522a7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265293.773794:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb9522a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265293.773799:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fae9200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789265293.773804:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb9522a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265293.773811:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb9522a7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265293.774013:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a1032d00500) 00010000:00010000:3.0:1789265293.774017:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265293.774022:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb9522a7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265293.774028:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb9522a7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265294.052836:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265294.052945:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397490304 00000100:00100000:2.0:1789265294.052955:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397490304 00000100:00100000:2.0:1789265294.053063:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 53 00000100:00100000:2.0:1789265294.053096:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1009073800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+39:10342:x1876180397490304:12345-192.168.203.37@tcp:101:stat.0 00010000:00010000:2.0:1789265294.053120:0:7934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265294.053139:0:7934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb9522ae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99efe45 expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.053214:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb9522b5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.053228:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb9522b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.053239:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb9522b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.053252:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb9522bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.053260:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb9522bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.053283:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb9522bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.053428:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7e00/0x27274ba5bb9522c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.053440:0:7934:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262600/0x27274ba5bb952299 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe3e expref: 40 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.053448:0:7934:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7e00/0x27274ba5bb9522c3 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.053480:0:7934:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262600/0x27274ba5bb952299 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe3e expref: 40 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.053510:0:7934:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262600/0x27274ba5bb952299 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe3e expref: 40 pid: 5841 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265294.053524:0:7934:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10037b2300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7934:1876180414296448:192.168.203.37@tcp:104: 00000100:00100000:2.0:1789265294.053656:0:7934:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10012ed780 going to sleep for 11 seconds 00000100:00080000:1.0:1789265294.053950:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265294.057110:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265294.059980:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397490560 00000100:00100000:0.0:1789265294.059995:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397490560 00000100:00100000:0.0:1789265294.060104:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 13 00000100:00100000:0.0:1789265294.060116:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1009071180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+41:5586:x1876180397490560:12345-192.168.203.37@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789265294.060464:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1009071180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+42:5586:x1876180397490560:12345-192.168.203.37@tcp:35:ldlm_bl.0 Request processed in 349us (3389us total) trans 4294967337 rc 0/0 00000100:00100000:0.0:1789265294.060473:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 13 00000100:00100000:1.0:1789265294.063888:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265294.064112:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397490688 00000100:00100000:3.0:1789265294.064134:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397490688 00010000:00010000:3.0:1789265294.064183:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262600/0x27274ba5bb952299 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe3e expref: 42 pid: 5841 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265294.064223:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 39 00000100:00100000:3.0:1789265294.064233:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1009071880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+42:2350:x1876180397490688:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265294.064247:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265294.064254:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262600/0x27274ba5bb952299 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe3e expref: 42 pid: 5841 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265294.064269:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262600/0x27274ba5bb952299 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe3e expref: 42 pid: 5841 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265294.064291:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262600/0x27274ba5bb952299 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe3e expref: 42 pid: 5841 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265294.064316:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a1032d00500) 00010000:00010000:3.0:1789265294.064322:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7e00/0x27274ba5bb9522c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265294.064332:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7e00/0x27274ba5bb9522c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265294.064339:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7e00/0x27274ba5bb9522c3 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265294.064356:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265294.064409:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1009071880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+41:2350:x1876180397490688:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 177us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265294.064424:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 39 00000100:00100000:2.0:1789265294.064654:0:7934:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10037b2300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7934:1876180414296448:192.168.203.37@tcp:104: 00010000:00010000:2.0:1789265294.064679:0:7934:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7e00/0x27274ba5bb9522c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.064688:0:7934:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7e00/0x27274ba5bb9522c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.064695:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7e00/0x27274ba5bb9522c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265294.064740:0:7934:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789265294.064743:0:7934:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789265294.064793:0:7934:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7e00/0x27274ba5bb9522c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.064804:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7e00/0x27274ba5bb9522c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.064813:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb9522b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.064820:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb9522b5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.064827:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb9522b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.064943:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad6c00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789265294.064948:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb9522b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.064956:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb9522b5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.064965:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a101b706300) 00010000:00010000:2.0:1789265294.064968:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265294.064971:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb9522b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.064978:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb9522b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.064999:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb9522bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.065005:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb9522bc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.065011:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb9522bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.065016:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad6a00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789265294.065019:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb9522bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.065025:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb9522bc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.065031:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8a1012931b00) 00010000:00010000:2.0:1789265294.065033:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265294.065036:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb9522bc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.065041:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb9522bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.065072:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb9522ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe45 expref: 41 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.065122:0:7934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7e00/0x27274ba5bb9522c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe45 expref: 40 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.065138:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a1032d00500) 00010000:00010000:2.0:1789265294.065141:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789265294.065143:0:7934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fad7e00, rc 0) 00000100:00100000:2.0:1789265294.065183:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1009073800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+40:10342:x1876180397490304:12345-192.168.203.37@tcp:101:stat.0 Request processed in 12111us (12355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265294.065190:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 53 00000100:00100000:3.0:1789265294.183435:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265294.183554:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397490944 00000100:00100000:1.0:1789265294.183565:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397490944 00000100:00100000:1.0:1789265294.183630:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 54 00000100:00100000:1.0:1789265294.183639:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+40:10348:x1876180397490944:12345-192.168.203.37@tcp:36:truncate.0 00010000:00010000:1.0:1789265294.183694:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265294.183723:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7e00/0x27274ba5bb9522c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe45 expref: 40 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265294.183753:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a1032d00500) 00010000:00010000:1.0:1789265294.183758:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789265294.184166:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb9522ca lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265294.184180:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb9522ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265294.184190:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb9522ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789265294.184235:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967338 00000004:00010000:1.0:1789265294.184254:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002853a6b0 reply state 0000000036a2512c transno 4294967339 ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb9522ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265294.184263:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789265294.184356:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+42:10348:x1876180397490944:12345-192.168.203.37@tcp:36:truncate.0 Request processed in 717us (928us total) trans 4294967339 rc 0/0 00000100:00100000:1.0:1789265294.184363:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 54 00000020:00080000:1.0:1789265294.184368:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789265294.187429:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb9522ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265294.187446:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb9522ca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265294.187453:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb9522ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265294.187459:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b596600 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789265294.187464:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb9522ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265294.187472:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb9522ca lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265294.187489:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a1032d00500) 00010000:00010000:3.0:1789265294.187492:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265294.187497:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb9522ca lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265294.187502:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb9522ca lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265294.403828:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265294.404144:0:11857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397491072 00000100:00100000:2.0:1789265294.404280:0:11857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397491072 00000100:00100000:2.0:1789265294.404347:0:11857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 55 00000100:00100000:2.0:1789265294.404357:0:11857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+41:10362:x1876180397491072:12345-192.168.203.37@tcp:101:stat.0 00010000:00010000:2.0:1789265294.404382:0:11857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265294.404401:0:11857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb9522d1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99efe4c expref: -99 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.405977:0:11857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb9522d8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.406000:0:11857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb9522d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.406015:0:11857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb9522d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.406040:0:11857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb9522df lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.406048:0:11857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb9522df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.406071:0:11857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb9522df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.406201:0:11857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb9522e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.406210:0:11857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb9522e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.406217:0:11857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb9522e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265294.406250:0:11857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1789265294.406255:0:11857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789265294.406276:0:11857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb9522e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.406289:0:11857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb9522e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.406296:0:11857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb9522d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.406302:0:11857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb9522d8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.406308:0:11857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb9522d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.406315:0:11857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad6a00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789265294.406319:0:11857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb9522d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.406334:0:11857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb9522d8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.406346:0:11857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a101b706300) 00010000:00010000:2.0:1789265294.406349:0:11857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265294.406354:0:11857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb9522d8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.406361:0:11857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb9522d8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.406373:0:11857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb9522df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.406379:0:11857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb9522df lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.406386:0:11857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb9522df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.406390:0:11857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad6c00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789265294.406393:0:11857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb9522df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.406398:0:11857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb9522df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.406404:0:11857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8a1012931b00) 00010000:00010000:2.0:1789265294.406406:0:11857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265294.406409:0:11857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb9522df lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.406424:0:11857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb9522df lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.406476:0:11857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb9522d1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe4c expref: 43 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.406493:0:11857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb9522e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe4c expref: 42 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.406500:0:11857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a1032d00500) 00010000:00010000:2.0:1789265294.406502:0:11857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789265294.406505:0:11857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fad7400, rc 0) 00000100:00100000:2.0:1789265294.406573:0:11857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+42:10362:x1876180397491072:12345-192.168.203.37@tcp:101:stat.0 Request processed in 2217us (2753us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265294.406581:0:11857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 55 00000100:00100000:0.0:1789265294.521330:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265294.521437:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397491328 00000100:00100000:2.0:1789265294.521448:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397491328 00000100:00100000:2.0:1789265294.521508:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 56 00000100:00100000:2.0:1789265294.521518:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10031fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+42:10372:x1876180397491328:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:2.0:1789265294.521538:0:7934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265294.521559:0:7934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb9522ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99efe53 expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265294.521646:0:7934:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1789265294.521771:0:7934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb9522ed lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe53 expref: 44 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.521803:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a101b706400) 00010000:00010000:2.0:1789265294.521806:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789265294.521812:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb9522ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe53 expref: 44 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.521825:0:7934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fad6600, rc 0) 00000100:00100000:2.0:1789265294.521885:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10031fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+43:10372:x1876180397491328:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 368us (564us total) trans 4294967340 rc 301/301 00000100:00100000:2.0:1789265294.521892:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 56 00000100:00100000:1.0:1789265294.530910:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265294.531024:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397491584 00000100:00100000:0.0:1789265294.531033:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397491584 00000100:00100000:0.0:1789265294.531127:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 14 00000100:00100000:0.0:1789265294.531137:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1009073b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+43:10372:x1876180397491584:12345-192.168.203.37@tcp:35:lfs.0 00000100:00100000:0.0:1789265294.531362:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1009073b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+44:10372:x1876180397491584:12345-192.168.203.37@tcp:35:lfs.0 Request processed in 225us (459us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1789265294.531369:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 14 00000100:00100000:3.0:1789265294.636648:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265294.636890:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397491840 00000100:00100000:0.0:1789265294.636900:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397491840 00000100:00100000:0.0:1789265294.636966:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 57 00000100:00100000:0.0:1789265294.636977:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103f98d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+44:10378:x1876180397491840:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:0.0:1789265294.636999:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265294.637019:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262800/0x27274ba5bb9522fb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99efe5a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265294.637169:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263a00/0x27274ba5bb952302 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265294.637185:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb9522e6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe4c expref: 45 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265294.637194:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263a00/0x27274ba5bb952302 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265294.637226:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb9522e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe4c expref: 45 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265294.637242:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb9522e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe4c expref: 45 pid: 11857 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265294.637270:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10031fe680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1876180414296576:192.168.203.37@tcp:104: 00000100:00100000:0.0:1789265294.637357:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a0f0294c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265294.641277:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10031fe680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1876180414296576:192.168.203.37@tcp:104: 00010000:00010000:0.0:1789265294.641306:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263a00/0x27274ba5bb952302 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265294.641900:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265294.642038:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397491968 00000100:00100000:2.0:1789265294.642046:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397491968 00010000:00010000:2.0:1789265294.642121:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb9522e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe4c expref: 46 pid: 11857 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265294.642170:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 40 00000100:00100000:2.0:1789265294.642181:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103f98fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+46:2351:x1876180397491968:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265294.642195:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265294.642201:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb9522e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe4c expref: 46 pid: 11857 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.642313:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb9522e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe4c expref: 46 pid: 11857 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.642336:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb9522e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe4c expref: 46 pid: 11857 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.642370:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a1032d00500) 00010000:00010000:2.0:1789265294.642375:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263a00/0x27274ba5bb952302 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.642384:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263a00/0x27274ba5bb952302 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.642392:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263a00/0x27274ba5bb952302 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.642420:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265294.643568:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103f98fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+45:2351:x1876180397491968:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 1383us (1663us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265294.643580:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 40 00010000:00010000:2.0:1789265294.643716:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265294.644388:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263a00/0x27274ba5bb952302 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265294.644401:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263a00/0x27274ba5bb952302 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265294.644423:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1789265294.644579:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262800/0x27274ba5bb9522fb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe5a expref: 46 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265294.644598:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263a00/0x27274ba5bb952302 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe5a expref: 45 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265294.644606:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a1032d00500) 00010000:00010000:0.0:1789265294.644609:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789265294.644611:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1017263a00, rc 0) 00000100:00100000:0.0:1789265294.644673:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103f98d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+45:10378:x1876180397491840:12345-192.168.203.37@tcp:101:bash.0 Request processed in 7699us (8034us total) trans 4294967342 rc 0/0 00000100:00100000:0.0:1789265294.644682:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 57 00000100:00100000:2.0:1789265294.649038:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265294.649103:0:11857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397492224 00000100:00100000:3.0:1789265294.649128:0:11857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397492224 00000100:00100000:3.0:1789265294.649194:0:11857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 58 00000100:00100000:3.0:1789265294.649205:0:11857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10037b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+45:10378:x1876180397492224:12345-192.168.203.37@tcp:36:bash.0 00010000:00010000:3.0:1789265294.649471:0:11857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb952310 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265294.649489:0:11857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb952310 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265294.649501:0:11857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb952310 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789265294.649550:0:11857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967343 00000004:00010000:3.0:1789265294.649587:0:11857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009990e289 reply state 00000000a645f7cf transno 4294967344 ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb952310 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265294.649605:0:11857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789265294.649693:0:11857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10037b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+48:10378:x1876180397492224:12345-192.168.203.37@tcp:36:bash.0 Request processed in 490us (665us total) trans 4294967344 rc 0/0 00000100:00100000:3.0:1789265294.649983:0:11857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 58 00000020:00080000:3.0:1789265294.649991:0:11857:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789265294.656684:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb952310 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.656701:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb952310 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.656710:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb952310 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.656716:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fae9200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789265294.656721:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb952310 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.656728:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb952310 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.656767:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a1032d00500) 00010000:00010000:2.0:1789265294.656771:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265294.656775:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb952310 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.656783:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb952310 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265294.665244:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265294.665346:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397492352 00000100:00100000:0.0:1789265294.665363:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397492352 00000100:00100000:0.0:1789265294.665421:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 59 00000100:00100000:0.0:1789265294.665431:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10037b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+47:10378:x1876180397492352:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:0.0:1789265294.665456:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265294.665476:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262800/0x27274ba5bb952317 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99efe61 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265294.665559:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263400/0x27274ba5bb95231e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265294.665573:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263a00/0x27274ba5bb952302 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe5a expref: 48 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265294.665583:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263400/0x27274ba5bb95231e lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265294.665615:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263a00/0x27274ba5bb952302 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe5a expref: 48 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265294.665643:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263a00/0x27274ba5bb952302 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe5a expref: 48 pid: 5840 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265294.665657:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10031fe680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1876180414296704:192.168.203.37@tcp:104: 00000100:00100000:0.0:1789265294.665735:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a0f0294cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789265294.669724:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265294.670820:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397492480 00000100:00100000:2.0:1789265294.670833:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397492480 00010000:00010000:2.0:1789265294.670880:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263a00/0x27274ba5bb952302 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe5a expref: 49 pid: 5840 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265294.670917:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10031fe680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1876180414296704:192.168.203.37@tcp:104: 00010000:00010000:0.0:1789265294.670941:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263400/0x27274ba5bb95231e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265294.670983:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 41 00000100:00100000:2.0:1789265294.670998:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103f98f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+49:2351:x1876180397492480:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265294.671011:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265294.671018:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263a00/0x27274ba5bb952302 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe5a expref: 49 pid: 5840 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.671032:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263a00/0x27274ba5bb952302 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe5a expref: 49 pid: 5840 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.671053:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263a00/0x27274ba5bb952302 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe5a expref: 49 pid: 5840 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.671069:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a1032d00500) 00010000:00010000:2.0:1789265294.671118:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263400/0x27274ba5bb95231e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.671128:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263400/0x27274ba5bb95231e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.671136:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263400/0x27274ba5bb95231e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.671168:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265294.671218:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103f98f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+48:2351:x1876180397492480:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 223us (1503us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265294.671226:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 41 00010000:00010000:0.0:1789265294.671403:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263400/0x27274ba5bb95231e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265294.671417:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263400/0x27274ba5bb95231e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265294.671740:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789265294.671746:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789265294.671768:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263400/0x27274ba5bb95231e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265294.671807:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262800/0x27274ba5bb952317 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe61 expref: 48 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265294.671824:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263400/0x27274ba5bb95231e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe61 expref: 47 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265294.671831:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a1032d00500) 00010000:00010000:0.0:1789265294.671833:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789265294.671836:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1017263400, rc 0) 00000100:00100000:0.0:1789265294.671876:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10037b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+47:10378:x1876180397492352:12345-192.168.203.37@tcp:101:bash.0 Request processed in 6447us (6641us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265294.671883:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 59 00000100:00100000:3.0:1789265294.679596:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265294.679731:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397492736 00000100:00100000:0.0:1789265294.679739:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397492736 00000100:00100000:0.0:1789265294.679796:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 15 00000100:00100000:0.0:1789265294.679804:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1010a42050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+47:10378:x1876180397492736:12345-192.168.203.37@tcp:35:bash.0 00000100:00100000:0.0:1789265294.680037:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1010a42050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+48:10378:x1876180397492736:12345-192.168.203.37@tcp:35:bash.0 Request processed in 232us (448us total) trans 4294967345 rc 0/0 00000100:00100000:0.0:1789265294.680044:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 15 00000100:00100000:3.0:1789265294.819224:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265294.819803:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397492992 00000100:00100000:0.0:1789265294.819877:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397492992 00000100:00100000:0.0:1789265294.820300:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 60 00000100:00100000:0.0:1789265294.820313:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103f98e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+48:10388:x1876180397492992:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:0.0:1789265294.820337:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265294.820358:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262800/0x27274ba5bb952325 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99efe68 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265294.820444:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1789265294.820554:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262800/0x27274ba5bb952325 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe68 expref: 50 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265294.820568:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a101b706400) 00010000:00010000:0.0:1789265294.820571:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789265294.820576:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262800/0x27274ba5bb952325 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe68 expref: 50 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265294.820599:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1017262800, rc 0) 00000100:00100000:0.0:1789265294.820732:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103f98e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+49:10388:x1876180397492992:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 422us (1519us total) trans 4294967346 rc 301/301 00000100:00100000:0.0:1789265294.820739:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 60 00000100:00100000:2.0:1789265294.828828:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265294.829781:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397493120 00000100:00100000:1.0:1789265294.829794:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397493120 00000100:00100000:1.0:1789265294.829900:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 61 00000100:00100000:1.0:1789265294.829910:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10037b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+49:10388:x1876180397493120:12345-192.168.203.37@tcp:34:lfs.0 00010000:00010000:1.0:1789265294.830004:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb952333 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265294.830029:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb952333 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265294.830040:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb952333 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265294.830056:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596400/0x27274ba5bb95233a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265294.830063:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596400/0x27274ba5bb95233a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265294.830069:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596400/0x27274ba5bb95233a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265294.830198:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb952341 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265294.830207:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb952341 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265294.830214:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb952341 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789265294.830252:0:7934:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb952341 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265294.830278:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb952333 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265294.830283:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb952333 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265294.830289:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb952333 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265294.830294:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b597a00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789265294.830298:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb952333 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265294.830304:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb952333 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265294.830316:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a101b706300) 00010000:00010000:1.0:1789265294.830319:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265294.830323:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb952333 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265294.830329:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb952333 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265294.830341:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596400/0x27274ba5bb95233a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265294.830346:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596400/0x27274ba5bb95233a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265294.830350:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596400/0x27274ba5bb95233a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265294.830362:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b596400 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789265294.830365:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596400/0x27274ba5bb95233a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265294.830370:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596400/0x27274ba5bb95233a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265294.830377:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8a101cdf4e00) 00010000:00010000:1.0:1789265294.830379:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265294.830381:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596400/0x27274ba5bb95233a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265294.830385:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596400/0x27274ba5bb95233a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265294.830398:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb952341 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265294.830403:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb952341 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265294.830407:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb952341 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265294.830411:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b596600 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789265294.830414:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb952341 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265294.830419:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb952341 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265294.830435:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a1032d00500) 00010000:00010000:1.0:1789265294.830437:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265294.830440:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb952341 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265294.830445:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb952341 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265294.830517:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10037b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+49:10388:x1876180397493120:12345-192.168.203.37@tcp:34:lfs.0 Request processed in 608us (1698us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265294.830524:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 61 00000100:00100000:1.0:1789265294.842644:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265294.842737:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397493376 00000100:00100000:0.0:1789265294.842747:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397493376 00000100:00100000:0.0:1789265294.842805:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 16 00000100:00100000:0.0:1789265294.842816:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1009073100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+49:10388:x1876180397493376:12345-192.168.203.37@tcp:35:lfs.0 00000100:00100000:0.0:1789265294.843056:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1009073100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+50:10388:x1876180397493376:12345-192.168.203.37@tcp:35:lfs.0 Request processed in 243us (421us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1789265294.843121:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 16 00000100:00100000:0.0:1789265294.903747:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265294.903902:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397493632 00000100:00100000:2.0:1789265294.903913:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397493632 00000100:00100000:2.0:1789265294.903971:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 62 00000100:00100000:2.0:1789265294.903981:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10031fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+50:10391:x1876180397493632:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:2.0:1789265294.904015:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265294.904044:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb952348 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99efe6f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.904188:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb95234f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.904204:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb95234f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.904215:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb95234f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.904249:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb952356 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.904257:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb952356 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.904264:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb952356 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.904387:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb95235d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.904397:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb95235d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.904404:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb95235d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265294.904413:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789265294.904508:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb95234f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.904516:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb95234f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.904523:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb95234f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.904529:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad6a00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789265294.904533:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb95234f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.904551:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb95234f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.904565:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a101b706300) 00010000:00010000:2.0:1789265294.904568:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265294.904573:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb95234f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.904579:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb95234f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.904606:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb952356 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.904612:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb952356 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.904618:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb952356 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.904623:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad6200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789265294.904626:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb952356 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.904632:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb952356 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.904640:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8a1012931b00) 00010000:00010000:2.0:1789265294.904642:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265294.904645:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb952356 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.904662:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb952356 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.904707:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb952348 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe6f expref: 53 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.904721:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb95235d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe6f expref: 52 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265294.904728:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a1032d00500) 00010000:00010000:2.0:1789265294.904731:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789265294.904733:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fad6000, rc 0) 00000100:00100000:2.0:1789265294.905571:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10031fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+52:10391:x1876180397493632:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 1584us (1826us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1789265294.905581:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 62 00000100:00100000:2.0:1789265294.911177:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265294.911261:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397493760 00000100:00100000:0.0:1789265294.911271:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397493760 00000100:00100000:0.0:1789265294.911325:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 63 00000100:00100000:0.0:1789265294.911335:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10037b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+52:10391:x1876180397493760:12345-192.168.203.37@tcp:54:lfs.0 00010000:00010000:0.0:1789265294.911402:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262800/0x27274ba5bb95236b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265294.911419:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262800/0x27274ba5bb95236b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265294.911430:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262800/0x27274ba5bb95236b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265294.911455:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262800/0x27274ba5bb95236b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265294.911461:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262800/0x27274ba5bb95236b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265294.911468:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262800/0x27274ba5bb95236b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265294.911473:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1017262800 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789265294.911478:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262800/0x27274ba5bb95236b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265294.911485:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262800/0x27274ba5bb95236b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265294.911515:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a1032d00500) 00010000:00010000:0.0:1789265294.911517:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789265294.911521:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262800/0x27274ba5bb95236b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265294.911526:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262800/0x27274ba5bb95236b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265294.911609:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10037b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+52:10391:x1876180397493760:12345-192.168.203.37@tcp:54:lfs.0 Request processed in 274us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265294.911617:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 63 00000100:00100000:1.0:1789265294.915144:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265294.915270:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397493888 00000100:00100000:3.0:1789265294.915280:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397493888 00000100:00100000:3.0:1789265294.915349:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 4 00000100:00100000:3.0:1789265294.915360:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1009072300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+52:2351:x1876180397493888:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265294.915375:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265294.915401:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb95235d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe6f expref: 52 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265294.915433:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a1032d00500) 00010000:00010000:3.0:1789265294.915438:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265294.915495:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1009072300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+51:2351:x1876180397493888:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 137us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265294.915502:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 4 00000100:00100000:1.0:1789265294.926958:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265294.927048:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397494144 00000100:00100000:0.0:1789265294.927058:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397494144 00000100:00100000:0.0:1789265294.927130:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 17 00000100:00100000:0.0:1789265294.927139:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1009072d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+51:10391:x1876180397494144:12345-192.168.203.37@tcp:35:lfs.0 00000100:00100000:0.0:1789265294.927358:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1009072d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+52:10391:x1876180397494144:12345-192.168.203.37@tcp:35:lfs.0 Request processed in 219us (410us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1789265294.927366:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 17 00000004:00080000:3.0:1789265295.154382:0:6875:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 340959304565ns, next at 341959302435ns, rc = 0 00000100:00100000:0.0:1789265295.154569:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789265295.154591:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103f98ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414296832:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789265295.154666:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265295.157236:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414296832 00000100:00100000:3.0:1789265295.157251:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414296832 00000100:00100000:3.0:1789265295.157319:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789265295.157408:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10031fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1876180414296832:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789265295.158053:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1789265295.162237:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789265295.162345:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10031fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1876180414296832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5014us (7675us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265295.162356:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789265295.162421:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103f98ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414296832:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789265295.189019:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265295.189054:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397494400 00000100:00100000:3.0:1789265295.189065:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397494400 00000100:00100000:3.0:1789265295.189134:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 64 00000100:00100000:3.0:1789265295.189144:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103f98ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+52:10409:x1876180397494400:12345-192.168.203.37@tcp:101:cat.0 00010000:00010000:3.0:1789265295.189183:0:7934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265295.189204:0:7934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8600/0x27274ba5bb952372 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99efe76 expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265295.189304:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9000/0x27274ba5bb952379 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265295.189326:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9000/0x27274ba5bb952379 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265295.189337:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9000/0x27274ba5bb952379 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265295.189349:0:7934:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789265295.189652:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8600/0x27274ba5bb952372 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe76 expref: 55 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265295.189673:0:7934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9000/0x27274ba5bb952379 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe76 expref: 54 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265295.189681:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a1032d00500) 00010000:00010000:3.0:1789265295.189684:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789265295.189687:0:7934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fae9000, rc 0) 00000100:00100000:3.0:1789265295.189744:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103f98ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+54:10409:x1876180397494400:12345-192.168.203.37@tcp:101:cat.0 Request processed in 601us (733us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1789265295.189751:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 64 00000001:00080000:3.0:1789265295.212737:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967349 is committed 00000004:00080000:3.0:1789265295.212779:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:3.0:1789265295.212808:0:5863:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8a1002cd7180 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1789265295.212813:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a1008916900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8a1002cd7b40 00000020:00080000:3.0:1789265295.212816:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a1008916600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8a102ea4e800 00000004:00080000:3.0:1789265295.212850:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:1.0:1789265295.212982:0:5874:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1789265295.213132:0:5874:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1789265295.213381:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789265295.213401:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10037b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414296960:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789265295.213468:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265295.213783:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414296960 00000100:00100000:2.0:1789265295.213791:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414296960 00000100:00100000:2.0:1789265295.213842:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789265295.213852:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1009073480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3315:x1876180414296960:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789265295.213878:0:6682:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:2.0:1789265295.213910:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6aa6058d, atime: 0x6aa6058d, ctime: 0x6aa6058d, blocks: 0x1 00010000:00010000:2.0:1789265295.213918:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df92b299/0x27274ba5bb952387 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265295.213935:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=341s v=(0 0) 00010000:00010000:2.0:1789265295.213953:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265295.213959:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df92b299/0x27274ba5bb952387 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265295.213976:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df92b299/0x27274ba5bb952387 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265295.213986:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df92b299/0x27274ba5bb952387 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265295.213994:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df92b299/0x27274ba5bb952387 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265295.214019:0:6682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789265295.214530:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1009073480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3315:x1876180414296960:12345-0@lo:6:osp-syn-0-0.0 Request processed in 678us (1059us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789265295.214538:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000004:00080000:2.0:1789265295.214584:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a10037b1500/2, rc 0, transno 4294967301 00010000:00010000:1.0:1789265295.214918:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265295.214925:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df92b299/0x27274ba5bb952387 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.214936:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad6c00 already unused, calling callback (ffffffffc1581350) 00010000:00010000:1.0:1789265295.214940:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df92b299/0x27274ba5bb952387 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.214970:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df92b299/0x27274ba5bb952387 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.214988:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df92b299/0x27274ba5bb952387 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.214996:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df92b299/0x27274ba5bb952387 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.215014:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265295.215016:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265295.215018:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265295.215734:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10037b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414296960:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789265295.230359:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265295.230796:0:11857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397494528 00000100:00100000:2.0:1789265295.230807:0:11857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397494528 00000100:00100000:2.0:1789265295.230882:0:11857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 65 00000100:00100000:2.0:1789265295.230891:0:11857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103f98f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+13:10410:x1876180397494528:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:2.0:1789265295.230914:0:11857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265295.230935:0:11857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb95238e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99efe7d expref: -99 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265295.231020:0:11857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952395 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265295.231034:0:11857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952395 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265295.231047:0:11857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952395 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265295.231120:0:11857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1789265295.231124:0:11857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789265295.231145:0:11857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952395 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265295.231183:0:11857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb95238e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe7d expref: 15 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265295.231202:0:11857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952395 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe7d expref: 14 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265295.231211:0:11857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a101b706300) 00010000:00010000:2.0:1789265295.231214:0:11857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789265295.231218:0:11857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fad6a00, rc 0) 00000100:00100000:2.0:1789265295.231289:0:11857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103f98f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+14:10410:x1876180397494528:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 398us (937us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265295.231296:0:11857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 65 00000100:00100000:3.0:1789265295.240332:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265295.240676:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397494912 00000100:00100000:0.0:1789265295.240686:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397494912 00000100:00100000:0.0:1789265295.240753:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 18 00000100:00100000:0.0:1789265295.240764:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103f98dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+14:10410:x1876180397494912:12345-192.168.203.37@tcp:35:lfs.0 00000100:00100000:0.0:1789265295.241150:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103f98dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+15:10410:x1876180397494912:12345-192.168.203.37@tcp:35:lfs.0 Request processed in 387us (825us total) trans 4294967351 rc 0/0 00000100:00100000:0.0:1789265295.241177:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 18 00000100:00100000:3.0:1789265295.246949:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265295.247158:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397495040 00000100:00100000:1.0:1789265295.247168:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397495040 00000100:00100000:1.0:1789265295.247230:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 5 00000100:00100000:1.0:1789265295.247239:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103f98c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+15:10410:x1876180397495040:12345-192.168.203.37@tcp:103:lfs.0 00010000:00010000:1.0:1789265295.247254:0:8490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789265295.247276:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263400/0x27274ba5bb95231e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe61 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.247298:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9000/0x27274ba5bb952379 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe76 expref: 14 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.247310:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb952229 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe22 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.247336:0:8490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a1032d00500) 00010000:00010000:1.0:1789265295.247346:0:8490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265295.247394:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103f98c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+12:10410:x1876180397495040:12345-192.168.203.37@tcp:103:lfs.0 Request processed in 156us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265295.247402:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 5 00000100:00100000:3.0:1789265295.250446:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265295.250533:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397495168 00000100:00100000:1.0:1789265295.250542:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397495168 00000100:00100000:1.0:1789265295.250605:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 66 00000100:00100000:1.0:1789265295.250615:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103f98ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+12:10410:x1876180397495168:12345-192.168.203.37@tcp:58:lfs.0 00010000:00010000:1.0:1789265295.250808:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb95239c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.250896:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb95239c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.250909:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb95239c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789265295.252424:0:5842:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789265295.252610:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1789265295.252662:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1789265295.255145:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103f98ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+12:10410:x1876180397495168:12345-192.168.203.37@tcp:58:lfs.0 Request processed in 4519us (4696us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265295.255168:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 66 00000100:00100000:3.0:1789265295.291032:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265295.291201:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397495296 00000100:00100000:2.0:1789265295.291210:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397495296 00000100:00100000:2.0:1789265295.291277:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 67 00000100:00100000:2.0:1789265295.291288:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103f98d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+12:10412:x1876180397495296:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:2.0:1789265295.291309:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265295.291328:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb9523a3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99efe84 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265295.291399:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb9523aa lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265295.291413:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb9523aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265295.291423:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb9523aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265295.291436:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7600/0x27274ba5bb9523b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265295.291442:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7600/0x27274ba5bb9523b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265295.291448:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7600/0x27274ba5bb9523b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265295.291662:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6400/0x27274ba5bb9523b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265295.291670:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6400/0x27274ba5bb9523b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265295.291678:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6400/0x27274ba5bb9523b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265295.291721:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789265295.291725:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789265295.291756:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6400/0x27274ba5bb9523b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265295.291769:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6400/0x27274ba5bb9523b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265295.291777:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb9523aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265295.291782:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb9523aa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265295.291788:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb9523aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265295.291799:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad7a00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789265295.291803:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb9523aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265295.291810:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb9523aa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265295.291822:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a101b706300) 00010000:00010000:2.0:1789265295.291825:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265295.291829:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb9523aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265295.291836:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb9523aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265295.291858:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7600/0x27274ba5bb9523b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265295.291864:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7600/0x27274ba5bb9523b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265295.291869:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7600/0x27274ba5bb9523b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265295.291874:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad7600 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789265295.291876:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7600/0x27274ba5bb9523b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265295.291882:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7600/0x27274ba5bb9523b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265295.291889:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8a1012931f00) 00010000:00010000:2.0:1789265295.291891:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265295.291893:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7600/0x27274ba5bb9523b1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265295.291898:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7600/0x27274ba5bb9523b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265295.291930:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb9523a3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe84 expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265295.291942:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6400/0x27274ba5bb9523b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe84 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265295.291978:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a101cdf4700) 00010000:00010000:2.0:1789265295.291981:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789265295.291984:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fad6400, rc 0) 00000100:00100000:2.0:1789265295.292053:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103f98d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+13:10412:x1876180397495296:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 766us (1038us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265295.292061:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 67 00000040:00080000:1.0:1789265295.539367:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789265295.539376:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789265295.539428:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1789265295.539439:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789265295.539561:0:11671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1009071c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11671:1876180414297088:192.168.203.37@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789265295.539672:0:11671:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1002cd7300 going to sleep for 11 seconds 00000100:00100000:3.0:1789265295.546259:0:11671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1009071c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11671:1876180414297088:192.168.203.37@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789265295.551624:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265295.552540:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397495424 00000100:00100000:3.0:1789265295.552552:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397495424 00000100:00100000:3.0:1789265295.552616:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 1 00000100:00100000:3.0:1789265295.552629:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1009070380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+13:10423:x1876180397495424:12345-192.168.203.37@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1789265295.552724:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1009070380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+13:10423:x1876180397495424:12345-192.168.203.37@tcp:900:lhsmtool_posix.0 Request processed in 97us (1109us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265295.552731:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 1 00000100:00100000:1.0:1789265295.555699:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265295.557007:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397495552 00000100:00100000:3.0:1789265295.557021:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397495552 00000100:00100000:3.0:1789265295.557097:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 68 00000100:00100000:3.0:1789265295.557108:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1009071c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+13:10423:x1876180397495552:12345-192.168.203.37@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789265295.557163:0:5840:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789265295.557292:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1009071c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+13:10423:x1876180397495552:12345-192.168.203.37@tcp:53:lhsmtool_posix.0 Request processed in 186us (1605us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265295.557299:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 68 00000100:00100000:2.0:1789265295.571041:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265295.571256:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397495680 00000100:00100000:1.0:1789265295.571266:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397495680 00000100:00100000:1.0:1789265295.571327:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 69 00000100:00100000:1.0:1789265295.571339:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10037b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+13:10423:x1876180397495680:12345-192.168.203.37@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789265295.571412:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597000/0x27274ba5bb9523bf lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.571430:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597000/0x27274ba5bb9523bf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.571442:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597000/0x27274ba5bb9523bf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.571466:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb9523c6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.571474:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb9523c6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.571480:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb9523c6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.571519:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596200/0x27274ba5bb9523cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.571527:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596200/0x27274ba5bb9523cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.571549:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596200/0x27274ba5bb9523cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265295.571585:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1789265295.571589:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789265295.571606:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596200/0x27274ba5bb9523cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.571617:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597000/0x27274ba5bb9523bf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.571622:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597000/0x27274ba5bb9523bf lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.571628:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597000/0x27274ba5bb9523bf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.571634:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b597000 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789265295.571639:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597000/0x27274ba5bb9523bf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.571646:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597000/0x27274ba5bb9523bf lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.571658:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a1032d00f00) 00010000:00010000:1.0:1789265295.571660:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265295.571665:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597000/0x27274ba5bb9523bf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.571671:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597000/0x27274ba5bb9523bf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.571691:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb9523c6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.571702:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb9523c6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.571708:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb9523c6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.571713:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b597800 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789265295.571716:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb9523c6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.571722:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb9523c6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.571729:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff8a101cdf4100) 00010000:00010000:1.0:1789265295.571732:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265295.571735:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb9523c6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.571740:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb9523c6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.571752:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596200/0x27274ba5bb9523cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.571760:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596200/0x27274ba5bb9523cd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.571766:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596200/0x27274ba5bb9523cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.571775:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b596200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789265295.571778:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596200/0x27274ba5bb9523cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.571784:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596200/0x27274ba5bb9523cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.571790:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a101cdf4700) 00010000:00010000:1.0:1789265295.571792:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265295.571795:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596200/0x27274ba5bb9523cd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.571800:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596200/0x27274ba5bb9523cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265295.571875:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10037b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+13:10423:x1876180397495680:12345-192.168.203.37@tcp:34:lhsmtool_posix.0 Request processed in 538us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265295.571882:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 69 00000100:00100000:3.0:1789265295.583102:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265295.585109:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397495936 00000100:00100000:1.0:1789265295.585135:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397495936 00000100:00100000:1.0:1789265295.585206:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 70 00000100:00100000:1.0:1789265295.585216:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103f98ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+13:10423:x1876180397495936:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789265295.585236:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265295.585256:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb9523d4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99efe8b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.585350:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596e00/0x27274ba5bb9523db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.585378:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596e00/0x27274ba5bb9523db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.585390:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596e00/0x27274ba5bb9523db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265295.585403:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1789265295.585507:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596e00/0x27274ba5bb9523db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.585514:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596e00/0x27274ba5bb9523db lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.585521:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596e00/0x27274ba5bb9523db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.585528:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b596e00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789265295.585532:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596e00/0x27274ba5bb9523db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.585539:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596e00/0x27274ba5bb9523db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.585552:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a101cdf4700) 00010000:00010000:1.0:1789265295.585555:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789265295.585559:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596e00/0x27274ba5bb9523db lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.585565:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596e00/0x27274ba5bb9523db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.585605:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb9523d4 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe8b expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.585622:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a1032d00f00) 00010000:00010000:1.0:1789265295.585625:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789265295.585629:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb9523d4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe8b expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.585639:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a101b597200, rc 0) 00000100:00100000:1.0:1789265295.585709:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103f98ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+14:10423:x1876180397495936:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 494us (2645us total) trans 4294967352 rc 301/301 00000100:00100000:1.0:1789265295.585717:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 70 00000100:00100000:0.0:1789265295.598679:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265295.598768:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397496064 00000100:00100000:2.0:1789265295.598778:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397496064 00000100:00100000:2.0:1789265295.598838:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 71 00000100:00100000:2.0:1789265295.598850:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10031fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+14:10423:x1876180397496064:12345-192.168.203.37@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789265295.598886:0:7934:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789265295.598998:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10031fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+14:10423:x1876180397496064:12345-192.168.203.37@tcp:53:lhsmtool_posix.0 Request processed in 150us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265295.599006:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 71 00000100:00100000:2.0:1789265295.608330:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265295.608383:0:11857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397496320 00000100:00100000:3.0:1789265295.608394:0:11857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397496320 00000100:00100000:3.0:1789265295.608457:0:11857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 72 00000100:00100000:3.0:1789265295.608468:0:11857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10037b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+14:10423:x1876180397496320:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789265295.608487:0:11857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265295.608498:0:11857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789265295.608526:0:11857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952395 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe7d expref: 14 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265295.608544:0:11857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a101b706300) 00010000:00010000:3.0:1789265295.608549:0:11857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789265295.608563:0:11857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8600/0x27274ba5bb9523e9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99efe92 expref: -99 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789265295.609197:0:11857:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:3.0:1789265295.609452:0:11857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb9523f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265295.609467:0:11857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb9523f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265295.609477:0:11857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb9523f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265295.609532:0:11857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8600/0x27274ba5bb9523e9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe92 expref: 16 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265295.609546:0:11857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb9523f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe92 expref: 15 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265295.609554:0:11857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8a1032d00600) 00010000:00010000:3.0:1789265295.609557:0:11857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789265295.609560:0:11857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fae8c00, rc 0) 00000100:00100000:3.0:1789265295.609620:0:11857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10037b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+15:10423:x1876180397496320:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 1154us (1298us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1789265295.609637:0:11857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 72 00000100:00100000:0.0:1789265295.626533:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265295.626620:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397496576 00000100:00100000:1.0:1789265295.626630:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397496576 00000100:00100000:1.0:1789265295.628105:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 73 00000100:00100000:1.0:1789265295.628125:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10031fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+15:10423:x1876180397496576:12345-192.168.203.37@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789265295.628204:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265295.628231:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb9523f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe92 expref: 15 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.628251:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8a1032d00600) 00010000:00010000:1.0:1789265295.628261:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789265295.628283:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb9523fe lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.628297:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb9523fe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.628308:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb9523fe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.628375:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596e00/0x27274ba5bb952405 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x1524159c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.628384:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596e00/0x27274ba5bb952405 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x1524159c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.628392:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596e00/0x27274ba5bb952405 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x1524159c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.628569:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb9523fe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.628578:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb9523fe lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.628586:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb9523fe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.628592:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b597200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789265295.628597:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb9523fe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.628605:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb9523fe lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.628614:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a101b706300) 00010000:00010000:1.0:1789265295.628617:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265295.628621:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb9523fe lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.628627:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb9523fe lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.628643:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596e00/0x27274ba5bb952405 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x1524159c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.628649:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596e00/0x27274ba5bb952405 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x1524159c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.628656:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596e00/0x27274ba5bb952405 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x1524159c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.628661:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b596e00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789265295.628665:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596e00/0x27274ba5bb952405 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x1524159c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.628671:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596e00/0x27274ba5bb952405 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x1524159c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.628679:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x1524159c (ffff8a101cdf4100) 00010000:00010000:1.0:1789265295.628682:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265295.628685:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596e00/0x27274ba5bb952405 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x1524159c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.628691:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596e00/0x27274ba5bb952405 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x1524159c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265295.628774:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10031fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+14:10423:x1876180397496576:12345-192.168.203.37@tcp:36:lhsmtool_posix.0 Request processed in 656us (2248us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789265295.628782:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 73 00000100:00100000:0.0:1789265295.634845:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265295.635046:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397496704 00000100:00100000:2.0:1789265295.635056:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397496704 00000100:00100000:2.0:1789265295.635138:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 74 00000100:00100000:2.0:1789265295.635157:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1010f81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+14:10423:x1876180397496704:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789265295.635176:0:7934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265295.635198:0:7934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7600/0x27274ba5bb95240c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99efe99 expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265295.635231:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952413 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265295.635256:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952413 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265295.635269:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952413 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265295.635358:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7600/0x27274ba5bb95240c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe99 expref: 16 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265295.635376:0:7934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952413 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe99 expref: 15 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265295.635385:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8a1012931f00) 00010000:00010000:2.0:1789265295.635387:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789265295.635390:0:7934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fad7a00, rc 0) 00000100:00100000:2.0:1789265295.635443:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1010f81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+15:10423:x1876180397496704:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 296us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265295.635450:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 74 00000100:00100000:2.0:1789265295.643273:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265295.643562:0:11857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397496960 00000100:00100000:3.0:1789265295.643573:0:11857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397496960 00000100:00100000:3.0:1789265295.643642:0:11857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 75 00000100:00100000:3.0:1789265295.643654:0:11857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10037b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+15:10423:x1876180397496960:12345-192.168.203.37@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789265295.643749:0:11857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8600/0x27274ba5bb95241a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265295.643765:0:11857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8600/0x27274ba5bb95241a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265295.643777:0:11857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8600/0x27274ba5bb95241a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789265295.644106:0:11857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:3.0:1789265295.644118:0:11857:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 341449042182ns, next at 342449038787ns, rc = 0 00000004:00010000:0.0:1789265295.644254:0:11857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000afad1412 reply state 000000007e2ed430 transno 4294967354 ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8600/0x27274ba5bb95241a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265295.644264:0:11857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789265295.644367:0:11857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10037b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+17:10423:x1876180397496960:12345-192.168.203.37@tcp:36:lhsmtool_posix.0 Request processed in 713us (1100us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1789265295.644374:0:11857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 75 00010000:00010000:3.0:1789265295.653291:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8600/0x27274ba5bb95241a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265295.653310:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8600/0x27274ba5bb95241a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265295.653318:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8600/0x27274ba5bb95241a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265295.653325:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fae8600 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789265295.653330:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8600/0x27274ba5bb95241a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265295.653338:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8600/0x27274ba5bb95241a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265295.653372:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8a1012931f00) 00010000:00010000:3.0:1789265295.653375:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789265295.653379:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8600/0x27274ba5bb95241a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265295.653385:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8600/0x27274ba5bb95241a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265295.661255:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265295.661396:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397497088 00000100:00100000:0.0:1789265295.661407:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397497088 00000100:00100000:0.0:1789265295.661470:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 76 00000100:00100000:0.0:1789265295.661481:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10037b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+16:10423:x1876180397497088:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789265295.661505:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265295.661524:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262a00/0x27274ba5bb952421 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99efea0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265295.661593:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262a00/0x27274ba5bb952421 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efea0 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265295.661611:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262a00/0x27274ba5bb952421 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efea0 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265295.661631:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8a1012931f00) 00010000:00010000:0.0:1789265295.661634:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789265295.661653:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1017262a00, rc 0) 00000100:00100000:0.0:1789265295.661725:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10037b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+17:10423:x1876180397497088:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 246us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265295.661732:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 76 00010000:00010000:2.0:1789265295.666304:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265295.678892:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265295.679046:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397497216 00000100:00100000:2.0:1789265295.679057:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397497216 00000100:00100000:2.0:1789265295.679140:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 25 00000100:00100000:2.0:1789265295.679155:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1010f83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2347:x1876180397497216:12345-192.168.203.37@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1789265295.679190:0:6684:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 4b820fcb-1bab-4b78-bfa4-355c22a09cf8@192.168.203.37@tcp t0 exp 0000000000000000 cur 341 last 0 00000020:00000080:2.0:1789265295.679221:0:6684:0:(genops.c:1385:class_connect()) connect: client 4b820fcb-1bab-4b78-bfa4-355c22a09cf8, cookie 0x27274ba5bb952428 00002000:00100000:2.0:1789265295.679242:0:6684:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4b820fcb-1bab-4b78-bfa4-355c22a09cf8/ffff8a103f9ab800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113969 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789265295.679266:0:6684:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789265295.679495:0:6684:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789265295.679522:0:6684:0:(import.c:65:import_set_state_nolock()) ffff8a103f9aa000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789265295.679579:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1010f83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:2347:x1876180397497216:12345-192.168.203.37@tcp:8:lhsmtool_posix.0 Request processed in 431us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265295.679586:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 25 00000100:00100000:1.0:1789265295.683302:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265295.683388:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397497344 00000100:00100000:2.0:1789265295.683398:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397497344 00000100:00100000:2.0:1789265295.683465:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 26 00000100:00100000:2.0:1789265295.683475:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1009070700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:0:x1876180397497344:12345-192.168.203.37@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1789265295.684972:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789265295.756291:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1009070700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+7:0:x1876180397497344:12345-192.168.203.37@tcp:2:lhsmtool_posix.0 Request processed in 72806us (72986us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789265295.756325:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 26 00000001:00080000:2.0:1789265295.756480:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:2.0:1789265295.756491:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4b820fcb-1bab-4b78-bfa4-355c22a09cf8 00000100:00100000:0.0:1789265295.775137:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265295.775241:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397497600 00000100:00100000:1.0:1789265295.775251:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397497600 00000100:00100000:1.0:1789265295.775309:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 19 00000100:00100000:1.0:1789265295.775320:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1010f81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+17:10423:x1876180397497600:12345-192.168.203.37@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789265295.775574:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1010f81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+18:10423:x1876180397497600:12345-192.168.203.37@tcp:35:lhsmtool_posix.0 Request processed in 255us (446us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1789265295.775581:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 19 00000100:00100000:0.0:1789265295.782665:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265295.785470:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397497856 00000100:00100000:1.0:1789265295.785485:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397497856 00000100:00100000:1.0:1789265295.785562:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 77 00000100:00100000:1.0:1789265295.785572:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1041b71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+18:10423:x1876180397497856:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789265295.785737:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1041b71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+18:10423:x1876180397497856:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 Request processed in 166us (3083us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265295.785753:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 77 00000100:00100000:0.0:1789265295.802324:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265295.802394:0:11857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397497984 00000100:00100000:3.0:1789265295.802404:0:11857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397497984 00000100:00100000:3.0:1789265295.802465:0:11857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 78 00000100:00100000:3.0:1789265295.802475:0:11857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1041b70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+18:10423:x1876180397497984:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789265295.802494:0:11857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265295.802514:0:11857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8600/0x27274ba5bb95242f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99efea7 expref: -99 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265295.802576:0:11857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb952436 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265295.802589:0:11857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb952436 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265295.802600:0:11857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb952436 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265295.802631:0:11857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789265295.802647:0:11857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb952436 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265295.802670:0:11857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8600/0x27274ba5bb95242f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efea7 expref: 20 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265295.802699:0:11857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb952436 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efea7 expref: 19 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265295.802707:0:11857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8a1012931f00) 00010000:00010000:3.0:1789265295.802709:0:11857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789265295.802712:0:11857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fae8c00, rc 0) 00000100:00100000:3.0:1789265295.802773:0:11857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1041b70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+19:10423:x1876180397497984:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 299us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265295.802780:0:11857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 78 00000100:00100000:0.0:1789265295.811933:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265295.812108:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397498112 00000100:00100000:2.0:1789265295.812117:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397498112 00000100:00100000:2.0:1789265295.812175:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 27 00000100:00100000:2.0:1789265295.812185:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1041b72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+5:2350:x1876180397498112:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789265295.812202:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265295.812225:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000adc23739/0x27274ba5bb95243d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99efeae expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789265295.812251:0:6685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa6058f, blocks: 0x1 00010000:00010000:2.0:1789265295.812269:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=341s v=(0 0) 00010000:00010000:2.0:1789265295.812273:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265295.812281:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000adc23739/0x27274ba5bb95243d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efeae expref: 6 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265295.812319:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000adc23739/0x27274ba5bb95243d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efeae expref: 6 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265295.812332:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fad7000, rc 0) 00000100:00100000:2.0:1789265295.812383:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1041b72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:2350:x1876180397498112:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 200us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265295.812390:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 27 00000100:00100000:1.0:1789265295.818946:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265295.819120:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397498368 00000100:00100000:2.0:1789265295.819130:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397498368 00000100:00100000:2.0:1789265295.819192:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 79 00000100:00100000:2.0:1789265295.819203:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1009070000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+19:10423:x1876180397498368:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789265295.819311:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1009070000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+19:10423:x1876180397498368:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 Request processed in 109us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265295.819318:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 79 00000100:00100000:0.0:1789265295.829681:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265295.829985:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397498496 00000100:00100000:3.0:1789265295.829995:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397498496 00000100:00100000:3.0:1789265295.830051:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 28 00000100:00100000:3.0:1789265295.830061:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1041b70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:10423:x1876180397498496:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789265295.830114:0:8856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265295.830134:0:8856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000282288b3/0x27274ba5bb952444 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99efeb5 expref: -99 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265295.830175:0:8856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000adc23739/0x27274ba5bb95243d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efeae expref: 7 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265295.830185:0:8856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265295.830189:0:8856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265295.830194:0:8856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000282288b3/0x27274ba5bb952444 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efeb5 expref: 7 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265295.830242:0:8856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000adc23739/0x27274ba5bb95243d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efeae expref: 7 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265295.830257:0:8856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000adc23739/0x27274ba5bb95243d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efeae expref: 7 pid: 6685 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265295.830271:0:8856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103f98e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8856:1876180414297216:192.168.203.37@tcp:104: 00000100:00100000:3.0:1789265295.830355:0:8856:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103bb47e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789265295.833202:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265295.833298:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397498624 00000100:00100000:1.0:1789265295.833308:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397498624 00010000:00010000:1.0:1789265295.833351:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000adc23739/0x27274ba5bb95243d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efeae expref: 8 pid: 6685 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265295.833385:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 42 00000100:00100000:1.0:1789265295.833393:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10118e7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+8:2351:x1876180397498624:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265295.833410:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265295.833449:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000adc23739/0x27274ba5bb95243d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efeae expref: 8 pid: 6685 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.833466:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000adc23739/0x27274ba5bb95243d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efeae expref: 8 pid: 6685 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.833493:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265295.833497:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265295.833505:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000282288b3/0x27274ba5bb952444 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efeb5 expref: 8 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.833514:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000282288b3/0x27274ba5bb952444 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efeb5 expref: 8 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265295.833552:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000282288b3/0x27274ba5bb952444 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efeb5 expref: 8 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265295.833568:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1009071180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5826:1876180414297344:192.168.203.37@tcp:105: 00000100:00100000:1.0:1789265295.833638:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1002cd73c0 going to sleep for 11 seconds 00010000:00010000:3.0:1789265295.834032:0:8856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000adc23739/0x27274ba5bb95243d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efeae expref: 8 pid: 6685 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265295.834048:0:8856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103f98e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8856:1876180414297216:192.168.203.37@tcp:104: 00010000:00010000:3.0:1789265295.834097:0:8856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000282288b3/0x27274ba5bb952444 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efeb5 expref: 7 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265295.834111:0:8856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fae8600, rc 0) 00000100:00100000:3.0:1789265295.834200:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1041b70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+7:10423:x1876180397498496:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 4140us (4528us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265295.834208:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 28 00000100:00100000:0.0:1789265295.854308:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265295.854521:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397498752 00000100:00100000:3.0:1789265295.854530:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397498752 00002000:00100000:3.0:1789265295.854578:0:6690:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8a1041b70000 x1876180397498752/t0(0) o4->4b820fcb-1bab-4b78-bfa4-355c22a09cf8@192.168.203.37@tcp:621/0 lens 504/0 e 0 to 0 dl 1789265306 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789265295.854619:0:6690:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a1041b70000 with x1876180397498752 ext(0->8) 00002000:00010000:3.0:1789265295.854625:0:6690:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a1041b70000 00000100:00100000:3.0:1789265295.854660:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 0 00000100:00100000:3.0:1789265295.854670:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1041b70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+7:2351:x1876180397498752:12345-192.168.203.37@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789265295.855527:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1041b70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+9:2351:x1876180397498752:12345-192.168.203.37@tcp:4:lhsmtool_posix.0 Request processed in 855us (1226us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1789265295.855536:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 0 00002000:00100000:3.0:1789265295.855544:0:6690:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8a1041b70000 x1876180397498752/t4294967302(0) o4->4b820fcb-1bab-4b78-bfa4-355c22a09cf8@192.168.203.37@tcp:621/0 lens 504/448 e 0 to 0 dl 1789265306 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789265295.855552:0:6690:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a1041b70000 with x1876180397498752 ext(0->8) 00002000:00010000:3.0:1789265295.855556:0:6690:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a1041b70000 00000100:00100000:1.0:1789265295.856229:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1009071180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5826:1876180414297344:192.168.203.37@tcp:105: 00010000:00010000:1.0:1789265295.856254:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265295.856281:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10118e7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+8:2351:x1876180397498624:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 22889us (23089us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265295.856290:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 42 00000100:00100000:1.0:1789265295.861269:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265295.861363:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397498880 00000100:00100000:3.0:1789265295.861374:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397498880 00000100:00100000:3.0:1789265295.861467:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 80 00000100:00100000:3.0:1789265295.861480:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1009071880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+19:10423:x1876180397498880:12345-192.168.203.37@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1789265296.001753:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1009071880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+19:10423:x1876180397498880:12345-192.168.203.37@tcp:44:lhsmtool_posix.0 Request processed in 140264us (140480us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265296.001768:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 80 00000001:00080000:2.0:1789265296.004994:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967351 is committed 00000001:00080000:2.0:1789265296.005107:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967355 is committed 00000020:00080000:2.0:1789265296.005117:0:5863:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000004:00080000:2.0:1789265296.005132:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000100:00100000:2.0:1789265296.005324:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103bee2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414297472:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789265296.005394:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265296.005464:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414297472 00000100:00100000:2.0:1789265296.005471:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414297472 00000100:00100000:2.0:1789265296.005519:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789265296.005526:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bee1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1876180414297472:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1789265296.005687:0:6685:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789265296.005691:0:6685:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789265296 00002000:00010000:2.0:1789265296.005694:0:6685:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789265296.005696:0:6685:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789265295 -> 1789265296 00002000:00010000:2.0:1789265296.005698:0:6685:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789265296.005739:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bee1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3317:x1876180414297472:12345-0@lo:2:osp-syn-1-0.0 Request processed in 213us (344us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1789265296.005746:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:2.0:1789265296.005785:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a103bee2a00/2, rc 0, transno 4294967303 00000100:00100000:2.0:1789265296.005791:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103bee2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414297472:0@lo:2:osp-syn-1-0.0 00000020:00080000:0.0:1789265296.006482:0:5874:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:0.0:1789265296.006496:0:5874:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00080000:0.0:1789265296.006505:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789265296.007870:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265296.009671:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397499008 00000100:00100000:2.0:1789265296.009686:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397499008 00000100:00100000:2.0:1789265296.009741:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 30 00000100:00100000:2.0:1789265296.009751:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103f98e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+8:2351:x1876180397499008:12345-192.168.203.37@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1789265296.074665:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103f98e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+8:2351:x1876180397499008:12345-192.168.203.37@tcp:16:lhsmtool_posix.0 Request processed in 64906us (66790us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265296.074678:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 30 00000001:00080000:2.0:1789265296.074713:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:2.0:1789265296.074722:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:0.0:1789265296.084573:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265296.084966:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397499264 00000100:00100000:3.0:1789265296.084976:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397499264 00000100:00100000:3.0:1789265296.085044:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 81 00000100:00100000:3.0:1789265296.085055:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1041b71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+13:10423:x1876180397499264:12345-192.168.203.37@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789265296.085131:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265296.085167:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb952436 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efea7 expref: 13 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265296.085200:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8a1012931f00) 00010000:00010000:3.0:1789265296.085205:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789265296.085231:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9000/0x27274ba5bb95244b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265296.085245:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9000/0x27274ba5bb95244b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265296.085254:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9000/0x27274ba5bb95244b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789265296.085496:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d7db3f73 reply state 00000000945325c1 transno 4294967356 ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9000/0x27274ba5bb95244b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265296.085507:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00080000:0.0:1789265296.085706:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265296.086974:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1041b71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+14:10423:x1876180397499264:12345-192.168.203.37@tcp:36:lhsmtool_posix.0 Request processed in 1915us (2405us total) trans 4294967356 rc 0/0 00000100:00100000:3.0:1789265296.086985:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 81 00010000:00010000:3.0:1789265296.099538:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9000/0x27274ba5bb95244b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265296.099555:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9000/0x27274ba5bb95244b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265296.099563:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9000/0x27274ba5bb95244b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265296.099569:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fae9000 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789265296.099573:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9000/0x27274ba5bb95244b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265296.099595:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9000/0x27274ba5bb95244b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265296.099612:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8a1012931f00) 00010000:00010000:3.0:1789265296.099615:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265296.099620:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9000/0x27274ba5bb95244b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265296.099625:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9000/0x27274ba5bb95244b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265296.101975:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265296.102533:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397499392 00000100:00100000:3.0:1789265296.102544:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397499392 00000100:00100000:3.0:1789265296.102613:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 31 00000100:00100000:3.0:1789265296.102625:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bee0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:2350:x1876180397499392:12345-192.168.203.37@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789265296.103327:0:6685:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1789265296.103332:0:6685:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1789265296 -> 1789265294 00002000:00010000:3.0:1789265296.103335:0:6685:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789265293 00002000:00010000:3.0:1789265296.103337:0:6685:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789265296 -> 1789265294 00002000:00010000:3.0:1789265296.103340:0:6685:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1789265296.103400:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bee0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+7:2350:x1876180397499392:12345-192.168.203.37@tcp:2:lhsmtool_posix.0 Request processed in 776us (1433us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1789265296.103415:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 31 00000100:00100000:2.0:1789265296.114340:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265296.114440:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397499648 00000100:00100000:1.0:1789265296.114464:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397499648 00000100:00100000:1.0:1789265296.114535:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 82 00000100:00100000:1.0:1789265296.114547:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bee2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+13:10423:x1876180397499648:12345-192.168.203.37@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789265296.114622:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb952452 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.114640:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952413 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe99 expref: 13 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.114648:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb952452 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.114683:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952413 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe99 expref: 13 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.114699:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952413 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe99 expref: 13 pid: 7934 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265296.114714:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1009072300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1876180414297600:192.168.203.37@tcp:104: 00000100:00100000:1.0:1789265296.114831:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1007e7a840 going to sleep for 11 seconds 00000100:00100000:2.0:1789265296.118166:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265296.118206:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397499776 00000100:00100000:0.0:1789265296.118217:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397499776 00010000:00010000:0.0:1789265296.118257:0:8490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952413 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe99 expref: 14 pid: 7934 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265296.118301:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 43 00000100:00100000:0.0:1789265296.118310:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bee0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+14:2351:x1876180397499776:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265296.118340:0:8490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265296.118348:0:8490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952413 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe99 expref: 14 pid: 7934 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.118365:0:8490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952413 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe99 expref: 14 pid: 7934 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.118389:0:8490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8a1012931f00) 00010000:00010000:0.0:1789265296.118394:0:8490:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb952452 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.118404:0:8490:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb952452 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.118408:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952413 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe99 expref: 14 pid: 7934 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.118412:0:8490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb952452 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265296.118433:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1009072300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1876180414297600:192.168.203.37@tcp:104: 00010000:00010000:0.0:1789265296.118445:0:8490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789265296.118458:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb952452 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.118469:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb952452 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.118483:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb952452 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265296.118497:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bee0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+13:2351:x1876180397499776:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 187us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265296.118506:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 43 00010000:00010000:1.0:1789265296.118512:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb952452 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.118521:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb952452 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.118541:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb952452 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.118548:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b596600 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789265296.118552:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb952452 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.118558:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb952452 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.118569:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8a1012931f00) 00010000:00010000:1.0:1789265296.118571:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1789265296.118575:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb952452 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.118590:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb952452 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265296.118632:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bee2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+12:10423:x1876180397499648:12345-192.168.203.37@tcp:55:lhsmtool_posix.0 Request processed in 4088us (4301us total) trans 0 rc -22/-22 00000100:00100000:1.0:1789265296.118639:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 82 00000100:00100000:2.0:1789265296.121580:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265296.121674:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397499904 00000100:00100000:0.0:1789265296.121693:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397499904 00000100:00100000:0.0:1789265296.121748:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 32 00000100:00100000:0.0:1789265296.121758:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bee0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+7:2350:x1876180397499904:12345-192.168.203.37@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789265296.121814:0:8856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ed47a06f/0x27274ba5bb952459 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.121836:0:8856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000282288b3/0x27274ba5bb952444 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efeb5 expref: 7 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.121856:0:8856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265296.121860:0:8856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789265296.121865:0:8856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed47a06f/0x27274ba5bb952459 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.121901:0:8856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000282288b3/0x27274ba5bb952444 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efeb5 expref: 7 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.121917:0:8856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000282288b3/0x27274ba5bb952444 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efeb5 expref: 7 pid: 8856 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265296.121931:0:8856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1041b70a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8856:1876180414297728:192.168.203.37@tcp:104: 00000100:00100000:0.0:1789265296.122305:0:8856:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10031cb600 going to sleep for 11 seconds 00000100:00100000:0.0:1789265296.127601:0:8856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1041b70a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8856:1876180414297728:192.168.203.37@tcp:104: 00010000:00010000:0.0:1789265296.127633:0:8856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ed47a06f/0x27274ba5bb952459 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265296.132552:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265296.136570:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397500032 00000100:00100000:0.0:1789265296.136593:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397500032 00010000:00010000:0.0:1789265296.136638:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000282288b3/0x27274ba5bb952444 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efeb5 expref: 8 pid: 8856 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265296.136682:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 44 00000100:00100000:0.0:1789265296.136693:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bee1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+8:2351:x1876180397500032:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265296.136714:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265296.136743:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000282288b3/0x27274ba5bb952444 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efeb5 expref: 8 pid: 8856 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.136760:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000282288b3/0x27274ba5bb952444 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efeb5 expref: 8 pid: 8856 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.136784:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000282288b3/0x27274ba5bb952444 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efeb5 expref: 8 pid: 8856 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.136956:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789265296.136962:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789265296.136968:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ed47a06f/0x27274ba5bb952459 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.136978:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed47a06f/0x27274ba5bb952459 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.137024:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789265296.137100:0:8856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ed47a06f/0x27274ba5bb952459 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265296.137110:0:8856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed47a06f/0x27274ba5bb952459 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265296.137120:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bee1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+7:2351:x1876180397500032:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 428us (4576us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265296.137128:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 44 00010000:00010000:3.0:1789265296.137140:0:8856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ed47a06f/0x27274ba5bb952459 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265296.137158:0:8856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ed47a06f/0x27274ba5bb952459 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265296.137166:0:8856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ed47a06f/0x27274ba5bb952459 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265296.137173:0:8856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1017262800 already unused, calling callback (ffffffffc1581350) 00010000:00010000:3.0:1789265296.137177:0:8856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed47a06f/0x27274ba5bb952459 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265296.137187:0:8856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed47a06f/0x27274ba5bb952459 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265296.137200:0:8856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ed47a06f/0x27274ba5bb952459 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265296.137208:0:8856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed47a06f/0x27274ba5bb952459 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265296.137261:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bee0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:2350:x1876180397499904:12345-192.168.203.37@tcp:1:lhsmtool_posix.0 Request processed in 15504us (15691us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265296.137760:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 32 00000100:00100000:3.0:1789265296.139710:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265296.141570:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397500288 00000100:00100000:0.0:1789265296.141584:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397500288 00000100:00100000:0.0:1789265296.141650:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 83 00000100:00100000:0.0:1789265296.141660:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103f98c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+12:10423:x1876180397500288:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789265296.141745:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262200/0x27274ba5bb952460 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.141762:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262200/0x27274ba5bb952460 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.141774:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262200/0x27274ba5bb952460 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.141973:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263400/0x27274ba5bb952467 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.141985:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262a00/0x27274ba5bb952421 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efea0 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.141993:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263400/0x27274ba5bb952467 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.142040:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262a00/0x27274ba5bb952421 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efea0 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.142056:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262a00/0x27274ba5bb952421 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efea0 expref: 13 pid: 5842 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265296.142070:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1041b70a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1876180414297856:192.168.203.37@tcp:104: 00000100:00100000:0.0:1789265296.142196:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10031cb600 going to sleep for 11 seconds 00000100:00100000:1.0:1789265296.159847:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265296.159883:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397500416 00000100:00100000:1.0:1789265296.159893:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397500416 00010000:00010000:1.0:1789265296.159935:0:8490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262a00/0x27274ba5bb952421 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efea0 expref: 14 pid: 5842 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265296.159939:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1041b70a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1876180414297856:192.168.203.37@tcp:104: 00010000:00010000:2.0:1789265296.159970:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263400/0x27274ba5bb952467 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265296.159981:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 45 00000100:00100000:1.0:1789265296.159993:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1009072300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+14:2351:x1876180397500416:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265296.160009:0:8490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265296.160017:0:8490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262a00/0x27274ba5bb952421 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efea0 expref: 14 pid: 5842 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.160033:0:8490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262a00/0x27274ba5bb952421 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efea0 expref: 14 pid: 5842 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.160056:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262a00/0x27274ba5bb952421 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efea0 expref: 14 pid: 5842 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.160069:0:8490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8a1012931f00) 00010000:00010000:1.0:1789265296.160103:0:8490:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263400/0x27274ba5bb952467 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.160114:0:8490:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263400/0x27274ba5bb952467 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.160122:0:8490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263400/0x27274ba5bb952467 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.160157:0:8490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265296.160212:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1009072300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+13:2351:x1876180397500416:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 221us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265296.160219:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 45 00010000:00010000:2.0:1789265296.160761:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263400/0x27274ba5bb952467 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.160769:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263400/0x27274ba5bb952467 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789265296.160947:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:2.0:1789265296.161141:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:2.0:1789265296.161194:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1789265296.161288:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103bee0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5840:1876180414297984:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789265296.161341:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265296.161381:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a102ec33780 going to sleep for 11 seconds 00000100:00100000:0.0:1789265296.161447:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414297984 00000100:00100000:0.0:1789265296.161454:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414297984 00000100:00100000:0.0:1789265296.161497:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789265296.161505:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bee3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5840:x1876180414297984:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789265296.161597:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bee3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5840:x1876180414297984:12345-0@lo:1000:mdt00_000.0 Request processed in 92us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265296.161604:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789265296.161945:0:5840:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:1.0:1789265296.161950:0:5840:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a103bee2a00, transno 4294967303 00000100:00100000:1.0:1789265296.161963:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103bee0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5840:1876180414297984:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1789265296.162816:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:1.0:1789265296.162887:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1009071180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5840:1876180414298112:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789265296.162935:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265296.162968:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1007e7ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1789265296.163464:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414298112 00000100:00100000:2.0:1789265296.163472:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414298112 00000100:00100000:2.0:1789265296.163523:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789265296.163541:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1009073b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5840:x1876180414298112:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789265296.163712:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1009073b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5840:x1876180414298112:12345-0@lo:1000:mdt00_000.0 Request processed in 172us (775us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1789265296.163720:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789265296.163868:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1009071180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5840:1876180414298112:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1789265296.163902:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263400/0x27274ba5bb952467 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.163912:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263400/0x27274ba5bb952467 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.163919:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263400/0x27274ba5bb952467 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.163925:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1017263400 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789265296.163929:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263400/0x27274ba5bb952467 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.163937:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263400/0x27274ba5bb952467 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.163953:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8a1012931f00) 00010000:00010000:1.0:1789265296.163956:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789265296.163970:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263400/0x27274ba5bb952467 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.163976:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263400/0x27274ba5bb952467 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.165854:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb95239c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.165873:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb95239c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.165880:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb95239c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.165885:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b597a00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789265296.165890:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb95239c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.165897:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb95239c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.165913:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a101cdf4700) 00010000:00010000:1.0:1789265296.165916:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789265296.165920:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb95239c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.165926:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb95239c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.165955:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596400/0x27274ba5bb95246e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.165970:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6400/0x27274ba5bb9523b8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe84 expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.165987:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596400/0x27274ba5bb95246e lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.166231:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6400/0x27274ba5bb9523b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe84 expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.166250:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6400/0x27274ba5bb9523b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe84 expref: 16 pid: 5841 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265296.166265:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103fa65180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1876180414298240:192.168.203.37@tcp:104: 00000100:00100000:1.0:1789265296.166347:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1007e7ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1789265296.173570:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103fa65180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1876180414298240:192.168.203.37@tcp:104: 00010000:00010000:2.0:1789265296.173600:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596400/0x27274ba5bb95246e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265296.177341:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265296.177487:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397500544 00000100:00100000:0.0:1789265296.177496:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397500544 00010000:00010000:0.0:1789265296.177536:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6400/0x27274ba5bb9523b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe84 expref: 17 pid: 5841 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265296.177578:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 46 00000100:00100000:0.0:1789265296.177588:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103f98c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+17:2350:x1876180397500544:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265296.177601:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265296.177609:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6400/0x27274ba5bb9523b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe84 expref: 17 pid: 5841 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.177624:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6400/0x27274ba5bb9523b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe84 expref: 17 pid: 5841 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.177647:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6400/0x27274ba5bb9523b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efe84 expref: 17 pid: 5841 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.177663:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a101cdf4700) 00010000:00010000:0.0:1789265296.177668:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596400/0x27274ba5bb95246e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.177678:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596400/0x27274ba5bb95246e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.177686:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596400/0x27274ba5bb95246e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.177730:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265296.177780:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103f98c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+16:2350:x1876180397500544:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 193us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265296.177788:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 46 00010000:00010000:3.0:1789265296.178164:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596400/0x27274ba5bb95246e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265296.178173:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596400/0x27274ba5bb95246e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265296.178185:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596400/0x27274ba5bb95246e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265296.178191:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596400/0x27274ba5bb95246e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265296.178198:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596400/0x27274ba5bb95246e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265296.178203:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b596400 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789265296.178207:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596400/0x27274ba5bb95246e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265296.178214:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596400/0x27274ba5bb95246e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265296.178224:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a101cdf4700) 00010000:00010000:3.0:1789265296.178227:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265296.178231:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596400/0x27274ba5bb95246e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265296.178236:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596400/0x27274ba5bb95246e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265296.178246:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262200/0x27274ba5bb952460 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265296.178258:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262200/0x27274ba5bb952460 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265296.178262:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262200/0x27274ba5bb952460 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265296.178267:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1017262200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789265296.178270:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262200/0x27274ba5bb952460 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265296.178274:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262200/0x27274ba5bb952460 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265296.178283:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a101cdf4700) 00010000:00010000:3.0:1789265296.178285:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789265296.178287:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262200/0x27274ba5bb952460 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265296.178292:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262200/0x27274ba5bb952460 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265296.178496:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103f98c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+15:10423:x1876180397500288:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 Request processed in 36836us (38795us total) trans 4294967361 rc 0/0 00000100:00100000:3.0:1789265296.178504:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 83 00000020:00080000:3.0:1789265296.178508:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789265296.178787:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789265296.178792:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789265296.178819:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789265296.178825:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789265296.183822:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265296.183946:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103f98ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:871daf34-1206-40e7-bd71-78303abe4d37:3318:1876180414298368:0@lo:400:kworker.0 00000100:00100000:3.0:1789265296.183996:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265296.184047:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789265296.184064:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103f98fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1876180414298752:0@lo:400:kworker.0 00000100:00100000:3.0:1789265296.184110:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265296.184155:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103f98d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1876180414298624:0@lo:400:kworker.0 00000100:00100000:3.0:1789265296.184179:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265296.184201:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789265296.184206:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103f98f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876180414298496:0@lo:400:kworker.0 00000100:00100000:3.0:1789265296.184241:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265296.184274:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414298752 00000100:00100000:3.0:1789265296.184282:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414298752 00000100:00100000:3.0:1789265296.184333:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414298624 00000100:00100000:3.0:1789265296.184336:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414298624 00000100:00100000:3.0:1789265296.184353:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414298496 00000100:00100000:3.0:1789265296.184356:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414298496 00000100:00100000:3.0:1789265296.184370:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789265296.184378:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103f98f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1876180414298752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265296.184430:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103f98f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1876180414298752:12345-0@lo:400:kworker.0 Request processed in 52us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265296.184444:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789265296.184461:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789265296.184467:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103f98c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1876180414298624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265296.184498:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103f98c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1876180414298624:12345-0@lo:400:kworker.0 Request processed in 31us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265296.184503:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789265296.184514:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1789265296.184520:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103fb31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876180414298496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265296.184753:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103fb31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876180414298496:12345-0@lo:400:kworker.0 Request processed in 233us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265296.184769:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:3.0:1789265296.184788:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265296.184823:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103f98f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876180414298496:0@lo:400:kworker.0 00000100:00100000:3.0:1789265296.184834:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103f98d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1876180414298624:0@lo:400:kworker.0 00000100:00100000:3.0:1789265296.184861:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103f98fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1876180414298752:0@lo:400:kworker.0 00000100:00100000:1.0:1789265296.184953:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397500800 00000100:00100000:1.0:1789265296.184958:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397500800 00000100:00100000:1.0:1789265296.185008:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 20 00000100:00100000:1.0:1789265296.185017:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103f98df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+15:10423:x1876180397500800:12345-192.168.203.37@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789265296.185765:0:5844:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789265296.185871:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967362 00010000:00010000:1.0:1789265296.185916:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb952475 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.185931:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb952475 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.185943:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb952475 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.185952:0:5844:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb952475 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.185965:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb952475 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.185971:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb952475 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.185988:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789265296.186833:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103f98df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+17:10423:x1876180397500800:12345-192.168.203.37@tcp:35:lhsmtool_posix.0 Request processed in 1812us (3014us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1789265296.186843:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 20 00000020:00080000:1.0:1789265296.186848:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789265296.186883:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265296.186891:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb952475 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.186899:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b597a00 already unused, calling callback (ffffffffc1581350) 00010000:00010000:1.0:1789265296.186904:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb952475 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.186912:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb952475 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.186925:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8a101cdf4100) 00010000:00010000:1.0:1789265296.186928:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789265296.186933:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb952475 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.186938:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb952475 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.186969:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265296.186971:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265296.186972:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265296.189491:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414298368 00000100:00100000:2.0:1789265296.189510:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414298368 00000100:00100000:2.0:1789265296.189562:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1789265296.189573:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+19:3318:x1876180414298368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265296.189673:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+19:3318:x1876180414298368:12345-0@lo:400:kworker.0 Request processed in 102us (5675us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265296.189680:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1789265296.189739:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103f98ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:871daf34-1206-40e7-bd71-78303abe4d37:3318:1876180414298368:0@lo:400:kworker.0 00000040:00080000:0.0:1789265296.325717:0:11991:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789265296.325726:0:11991:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789265296.325765:0:11991:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789265296.325771:0:11991:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789265296.466515:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265296.466646:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397501056 00000100:00100000:1.0:1789265296.466656:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397501056 00000100:00100000:1.0:1789265296.466718:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 84 00000100:00100000:1.0:1789265296.466729:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103fb30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+17:10434:x1876180397501056:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:1.0:1789265296.466753:0:7934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265296.466772:0:7934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb95247c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99efebc expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.466866:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597000/0x27274ba5bb952483 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.466881:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597000/0x27274ba5bb952483 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.466896:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597000/0x27274ba5bb952483 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265296.466907:0:7934:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1789265296.467026:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb95247c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efebc expref: 20 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.467044:0:7934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597000/0x27274ba5bb952483 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efebc expref: 19 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.467054:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a101b706300) 00010000:00010000:1.0:1789265296.467066:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789265296.467071:0:7934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a101b597000, rc 0) 00000100:00100000:1.0:1789265296.467174:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103fb30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+19:10434:x1876180397501056:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 446us (668us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1789265296.467183:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 84 00000100:00100000:2.0:1789265296.477737:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265296.478058:0:11857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397501184 00000100:00100000:0.0:1789265296.478068:0:11857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397501184 00000100:00100000:0.0:1789265296.478160:0:11857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 85 00000100:00100000:0.0:1789265296.478171:0:11857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bee1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+19:10434:x1876180397501184:12345-192.168.203.37@tcp:34:lfs.0 00010000:00010000:0.0:1789265296.478255:0:11857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263a00/0x27274ba5bb952491 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.478273:0:11857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263a00/0x27274ba5bb952491 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.478284:0:11857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263a00/0x27274ba5bb952491 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.478299:0:11857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262600/0x27274ba5bb952498 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.478306:0:11857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262600/0x27274ba5bb952498 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.478320:0:11857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262600/0x27274ba5bb952498 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.478566:0:11857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262800/0x27274ba5bb95249f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.478575:0:11857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262800/0x27274ba5bb95249f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.478759:0:11857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262800/0x27274ba5bb95249f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789265296.478800:0:11857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262800/0x27274ba5bb95249f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.478815:0:11857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263a00/0x27274ba5bb952491 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.478821:0:11857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263a00/0x27274ba5bb952491 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.478827:0:11857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263a00/0x27274ba5bb952491 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.478833:0:11857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1017263a00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789265296.478837:0:11857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263a00/0x27274ba5bb952491 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.478843:0:11857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263a00/0x27274ba5bb952491 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.478857:0:11857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a101b706300) 00010000:00010000:0.0:1789265296.478869:0:11857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265296.478875:0:11857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263a00/0x27274ba5bb952491 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.478881:0:11857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263a00/0x27274ba5bb952491 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.478894:0:11857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262600/0x27274ba5bb952498 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.478899:0:11857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262600/0x27274ba5bb952498 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.478907:0:11857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262600/0x27274ba5bb952498 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.478912:0:11857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1017262600 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789265296.478916:0:11857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262600/0x27274ba5bb952498 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.478923:0:11857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262600/0x27274ba5bb952498 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.478930:0:11857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8a101b706c00) 00010000:00010000:0.0:1789265296.478933:0:11857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265296.478935:0:11857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262600/0x27274ba5bb952498 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.478941:0:11857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262600/0x27274ba5bb952498 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.478954:0:11857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262800/0x27274ba5bb95249f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.478967:0:11857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262800/0x27274ba5bb95249f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.478973:0:11857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262800/0x27274ba5bb95249f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.478978:0:11857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1017262800 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789265296.478981:0:11857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262800/0x27274ba5bb95249f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.478986:0:11857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262800/0x27274ba5bb95249f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.478994:0:11857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a101b706100) 00010000:00010000:0.0:1789265296.478996:0:11857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265296.478999:0:11857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262800/0x27274ba5bb95249f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.479004:0:11857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262800/0x27274ba5bb95249f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265296.479109:0:11857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bee1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+19:10434:x1876180397501184:12345-192.168.203.37@tcp:34:lfs.0 Request processed in 939us (1379us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265296.479119:0:11857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 85 00000100:00100000:1.0:1789265296.541989:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265296.542068:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397501440 00000100:00100000:2.0:1789265296.542289:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397501440 00000100:00100000:2.0:1789265296.542572:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 86 00000100:00100000:2.0:1789265296.542584:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103fa65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+19:10437:x1876180397501440:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:2.0:1789265296.542605:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265296.542624:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7e00/0x27274ba5bb9524a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99efec3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.542697:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb9524ad lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.542712:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb9524ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.542723:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb9524ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.542738:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb9524b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.542746:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb9524b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.542752:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb9524b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.543009:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb9524bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.543018:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb9524bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.543026:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb9524bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265296.543036:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1789265296.543164:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb9524ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.543172:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb9524ad lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.543179:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb9524ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.543184:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad6600 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789265296.543189:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb9524ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.543197:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb9524ad lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.545102:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a101b706300) 00010000:00010000:2.0:1789265296.545106:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265296.545113:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb9524ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.545140:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb9524ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.545169:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb9524b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.545176:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb9524b4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.545183:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb9524b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.545188:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad6c00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789265296.545191:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb9524b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.545198:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb9524b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.545207:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8a1012931b00) 00010000:00010000:2.0:1789265296.545210:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265296.545213:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb9524b4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.545218:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb9524b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.545275:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7e00/0x27274ba5bb9524a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efec3 expref: 22 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.545290:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb9524bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efec3 expref: 21 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.545304:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a1012931200) 00010000:00010000:2.0:1789265296.545306:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789265296.545309:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fad6200, rc 0) 00000100:00100000:2.0:1789265296.545381:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103fa65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+21:10437:x1876180397501440:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 2799us (3401us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1789265296.545390:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 86 00000100:00100000:1.0:1789265296.550368:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265296.550405:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397501568 00000100:00100000:1.0:1789265296.550415:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397501568 00000100:00100000:1.0:1789265296.550464:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 87 00000100:00100000:1.0:1789265296.550474:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bcc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+21:10437:x1876180397501568:12345-192.168.203.37@tcp:54:lfs.0 00010000:00010000:1.0:1789265296.550540:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb9524c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.550556:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb9524c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.550567:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb9524c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.550593:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb9524c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.550599:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb9524c9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.550606:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb9524c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.550612:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b597a00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789265296.550616:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb9524c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.550630:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb9524c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.550642:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a1012931200) 00010000:00010000:1.0:1789265296.550645:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789265296.550650:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb9524c9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.550656:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb9524c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265296.550721:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bcc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+21:10437:x1876180397501568:12345-192.168.203.37@tcp:54:lfs.0 Request processed in 248us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265296.550729:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 87 00000100:00100000:0.0:1789265296.568642:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265296.571332:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397501824 00000100:00100000:2.0:1789265296.571347:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397501824 00000100:00100000:2.0:1789265296.571402:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 21 00000100:00100000:2.0:1789265296.571412:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1010a40850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+21:10437:x1876180397501824:12345-192.168.203.37@tcp:35:lfs.0 00000100:00100000:2.0:1789265296.571780:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1010a40850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+22:10437:x1876180397501824:12345-192.168.203.37@tcp:35:lfs.0 Request processed in 368us (3145us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1789265296.571789:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 21 00000100:00100000:1.0:1789265296.622252:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265296.633756:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397502080 00000100:00100000:2.0:1789265296.633775:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397502080 00000100:00100000:0.0:1789265296.634185:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265296.634228:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265296.634248:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265296.634273:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265296.634317:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397502464 00000100:00100000:0.0:1789265296.634322:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397502464 00000100:00100000:0.0:1789265296.634363:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397502336 00000100:00100000:0.0:1789265296.634367:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397502336 00000100:00100000:0.0:1789265296.634399:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 69 00000100:00100000:0.0:1789265296.634408:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1041b73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:2348:x1876180397502464:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789265296.634476:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1041b73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:2348:x1876180397502464:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 70us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265296.634484:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 69 00000100:00100000:0.0:1789265296.634501:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 70 00000100:00100000:0.0:1789265296.634507:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1041b71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+7:2348:x1876180397502336:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789265296.634532:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1041b71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+7:2348:x1876180397502336:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 25us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265296.634539:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 70 00000100:00100000:0.0:1789265296.634687:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397502592 00000100:00100000:0.0:1789265296.634691:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397502592 00000100:00100000:0.0:1789265296.634713:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 124 00000100:00100000:0.0:1789265296.634719:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1041b71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+5:2348:x1876180397502592:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789265296.634750:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1041b71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+5:2348:x1876180397502592:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 31us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265296.634755:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 124 00000100:00100000:0.0:1789265296.634767:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 88 00000100:00100000:0.0:1789265296.634773:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bcc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+22:9966:x1876180397502080:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:0.0:1789265296.634786:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265296.634803:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263400/0x27274ba5bb9524d0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99efeca expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.634911:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262200/0x27274ba5bb9524d7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.634927:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb9524bb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efec3 expref: 23 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.634935:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262200/0x27274ba5bb9524d7 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.634968:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb9524bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efec3 expref: 23 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.634983:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb9524bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efec3 expref: 23 pid: 5841 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265296.634996:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1041b73b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1876180414298880:192.168.203.37@tcp:104: 00000100:00100000:0.0:1789265296.635053:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10031cb600 going to sleep for 11 seconds 00000100:00100000:0.0:1789265296.635201:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397502208 00000100:00100000:0.0:1789265296.635206:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397502208 00000100:00100000:0.0:1789265296.635232:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 283 00000100:00100000:0.0:1789265296.635239:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1230cd-a81b-4bcc-a532-e24f5353fef4+13:2348:x1876180397502208:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789265296.635268:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1230cd-a81b-4bcc-a532-e24f5353fef4+13:2348:x1876180397502208:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 30us (1089us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265296.635274:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 283 00000100:00080000:2.0:1789265296.636597:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789265296.636606:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265296.640527:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1041b73b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1876180414298880:192.168.203.37@tcp:104: 00010000:00010000:3.0:1789265296.640561:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262200/0x27274ba5bb9524d7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265296.641029:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265296.641163:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397502720 00000100:00100000:1.0:1789265296.641171:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397502720 00010000:00010000:1.0:1789265296.641548:0:8490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb9524bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efec3 expref: 24 pid: 5841 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265296.641621:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 47 00000100:00100000:1.0:1789265296.641633:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1041b73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+24:2351:x1876180397502720:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265296.641649:0:8490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265296.641657:0:8490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb9524bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efec3 expref: 24 pid: 5841 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.641673:0:8490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb9524bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efec3 expref: 24 pid: 5841 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.641714:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb9524bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efec3 expref: 24 pid: 5841 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.641729:0:8490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a1012931200) 00010000:00010000:1.0:1789265296.641733:0:8490:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262200/0x27274ba5bb9524d7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.641742:0:8490:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262200/0x27274ba5bb9524d7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.641748:0:8490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262200/0x27274ba5bb9524d7 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.641786:0:8490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265296.641856:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1041b73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+23:2351:x1876180397502720:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 225us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265296.641863:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 47 00010000:00010000:2.0:1789265296.643523:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262200/0x27274ba5bb9524d7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.643539:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262200/0x27274ba5bb9524d7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265296.643563:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1789265296.643713:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263400/0x27274ba5bb9524d0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efeca expref: 24 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.643748:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262200/0x27274ba5bb9524d7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efeca expref: 23 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.643756:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a1012931200) 00010000:00010000:2.0:1789265296.643759:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789265296.643762:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1017262200, rc 0) 00000100:00100000:2.0:1789265296.643927:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bcc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+23:9966:x1876180397502080:12345-192.168.203.37@tcp:101:bash.0 Request processed in 9152us (21683us total) trans 4294967367 rc 0/0 00000100:00100000:2.0:1789265296.643935:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 88 00000100:00100000:0.0:1789265296.647616:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265296.647705:0:11857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397502976 00000100:00100000:1.0:1789265296.647714:0:11857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397502976 00000100:00100000:1.0:1789265296.647772:0:11857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 89 00000100:00100000:1.0:1789265296.647781:0:11857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1041b72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+23:9966:x1876180397502976:12345-192.168.203.37@tcp:36:bash.0 00010000:00010000:1.0:1789265296.648013:0:11857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb9524e5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.648030:0:11857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb9524e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.648040:0:11857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb9524e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789265296.648568:0:11857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000004:00010000:1.0:1789265296.648597:0:11857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000060dc8007 reply state 00000000b91a73c4 transno 4294967369 ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb9524e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265296.648607:0:11857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1789265296.648680:0:11857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000100:00100000:1.0:1789265296.648801:0:11857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1041b72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+27:9966:x1876180397502976:12345-192.168.203.37@tcp:36:bash.0 Request processed in 1019us (1191us total) trans 4294967370 rc 0/0 00000100:00100000:1.0:1789265296.648810:0:11857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 89 00000020:00080000:1.0:1789265296.648814:0:11857:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1789265296.655506:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb9524e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265296.655523:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb9524e5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265296.655530:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb9524e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265296.655535:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b597a00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789265296.655540:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb9524e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265296.655548:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb9524e5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265296.655563:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a1012931200) 00010000:00010000:3.0:1789265296.655566:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265296.655596:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb9524e5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265296.655603:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb9524e5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265296.658558:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265296.658785:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397503104 00000100:00100000:1.0:1789265296.658795:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397503104 00000100:00100000:1.0:1789265296.658855:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 90 00000100:00100000:1.0:1789265296.658864:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1041b72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+26:9966:x1876180397503104:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:1.0:1789265296.658887:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265296.659899:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596200/0x27274ba5bb9524ec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99efed1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.659968:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596200/0x27274ba5bb9524ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efed1 expref: 27 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.659982:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596200/0x27274ba5bb9524ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efed1 expref: 27 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.660001:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a1012931200) 00010000:00010000:1.0:1789265296.660004:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789265296.660007:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a101b596200, rc 0) 00000100:00100000:1.0:1789265296.660098:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1041b72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+27:9966:x1876180397503104:12345-192.168.203.37@tcp:101:bash.0 Request processed in 1233us (1549us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265296.660106:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 90 00000100:00100000:0.0:1789265296.672636:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265296.672819:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397503232 00000100:00100000:2.0:1789265296.672830:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397503232 00000100:00100000:2.0:1789265296.672891:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 33 00000100:00100000:2.0:1789265296.672902:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1041b73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:9966:x1876180397503232:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:2.0:1789265296.672920:0:6684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265296.672942:0:6684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e75e70fa/0x27274ba5bb9524f3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99efed8 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789265296.672971:0:6684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa6058e, atime: 0x6aa6058d, ctime: 0x6aa6058e, blocks: 0xb 00010000:00010000:2.0:1789265296.672993:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=342s v=(0 0) 00010000:00010000:2.0:1789265296.672998:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265296.673006:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e75e70fa/0x27274ba5bb9524f3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efed8 expref: 7 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.673191:0:6684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e75e70fa/0x27274ba5bb9524f3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efed8 expref: 7 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.673336:0:6684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fad6600, rc 0) 00000100:00100000:3.0:1789265296.673456:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1041b73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+7:9966:x1876180397503232:12345-192.168.203.37@tcp:101:bash.0 Request processed in 555us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265296.673464:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 33 00000100:00100000:2.0:1789265296.676633:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265296.679968:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397503360 00000100:00100000:0.0:1789265296.679985:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397503360 00002000:00010000:0.0:1789265296.680039:0:6688:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1789265296.680044:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a103bee1880 with x1876180397503360 ext(0->18446744073709551615) 00002000:00010000:0.0:1789265296.680055:0:6688:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a103bee1880. 00000100:00100000:0.0:1789265296.680102:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 1 00000100:00100000:0.0:1789265296.680112:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bee1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+7:2350:x1876180397503360:12345-192.168.203.37@tcp:10:bash.0 00002000:00010000:0.0:1789265296.680403:0:6688:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1789265296.680406:0:6688:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1789265294 -> 1789265296 00002000:00010000:0.0:1789265296.680409:0:6688:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1789265293 -> 1789265293 00002000:00010000:0.0:1789265296.680411:0:6688:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789265294 -> 1789265296 00002000:00010000:0.0:1789265296.680414:0:6688:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1789265296.680722:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bee1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+8:2350:x1876180397503360:12345-192.168.203.37@tcp:10:bash.0 Request processed in 609us (4097us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789265296.680729:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 1 00002000:00010000:0.0:1789265296.680733:0:6688:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1789265296.680736:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a103bee1880 with x1876180397503360 ext(0->18446744073709551615) 00002000:00010000:0.0:1789265296.680741:0:6688:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a103bee1880. 00000100:00100000:3.0:1789265296.691900:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103bee3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414299008:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789265296.691910:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265296.691977:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265296.692191:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414299008 00000100:00100000:2.0:1789265296.692199:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414299008 00000100:00100000:2.0:1789265296.692263:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789265296.692273:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103fb33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1876180414299008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789265296.692296:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1789265296.693155:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103fb33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1876180414299008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 871us (1166us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265296.693165:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789265296.696821:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103bee3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414299008:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789265296.806393:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265296.806503:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397503488 00000100:00100000:2.0:1789265296.806515:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397503488 00000100:00100000:2.0:1789265296.806577:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 91 00000100:00100000:2.0:1789265296.806595:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1041b71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+27:10451:x1876180397503488:12345-192.168.203.37@tcp:34:lfs.0 00010000:00010000:2.0:1789265296.806668:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb9524fa lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.806687:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb9524fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.806700:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb9524fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.806715:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7600/0x27274ba5bb952501 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.806740:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7600/0x27274ba5bb952501 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.806747:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7600/0x27274ba5bb952501 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.806977:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952508 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.806987:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952508 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.806994:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952508 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789265296.807032:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952508 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.807043:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb9524fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.807049:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb9524fa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.807056:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb9524fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.807061:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad7000 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789265296.807065:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb9524fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.807115:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb9524fa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.807136:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a101b706300) 00010000:00010000:2.0:1789265296.807139:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265296.807155:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb9524fa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.807161:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb9524fa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.807173:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7600/0x27274ba5bb952501 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.807179:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7600/0x27274ba5bb952501 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.807184:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7600/0x27274ba5bb952501 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.807189:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad7600 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789265296.807191:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7600/0x27274ba5bb952501 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.807197:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7600/0x27274ba5bb952501 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.807204:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8a1012931800) 00010000:00010000:2.0:1789265296.807206:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265296.807209:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7600/0x27274ba5bb952501 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.807214:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7600/0x27274ba5bb952501 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.807237:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952508 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.807243:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952508 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.807248:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952508 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.807253:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad6a00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789265296.807256:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952508 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.807262:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952508 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.807270:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a1012931200) 00010000:00010000:2.0:1789265296.807272:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265296.807275:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952508 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265296.807281:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952508 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265296.807355:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1041b71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+27:10451:x1876180397503488:12345-192.168.203.37@tcp:34:lfs.0 Request processed in 761us (971us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265296.807365:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 91 00000100:00100000:2.0:1789265296.858465:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265296.858619:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397503744 00000100:00100000:0.0:1789265296.858629:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397503744 00000100:00100000:0.0:1789265296.858686:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 92 00000100:00100000:0.0:1789265296.858697:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bee3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+27:10454:x1876180397503744:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:0.0:1789265296.858716:0:7934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265296.858748:0:7934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263a00/0x27274ba5bb95250f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99efedf expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.858813:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262600/0x27274ba5bb952516 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.858828:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262600/0x27274ba5bb952516 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.858839:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262600/0x27274ba5bb952516 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.858853:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263400/0x27274ba5bb95251d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.858859:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263400/0x27274ba5bb95251d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.858866:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263400/0x27274ba5bb95251d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.859433:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262800/0x27274ba5bb952524 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.859514:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262800/0x27274ba5bb952524 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.859524:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262800/0x27274ba5bb952524 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265296.859535:0:7934:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789265296.859680:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262600/0x27274ba5bb952516 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.859700:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262600/0x27274ba5bb952516 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.859708:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262600/0x27274ba5bb952516 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.859714:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1017262600 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789265296.859719:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262600/0x27274ba5bb952516 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.859727:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262600/0x27274ba5bb952516 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.859739:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a101b706300) 00010000:00010000:0.0:1789265296.859742:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265296.859746:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262600/0x27274ba5bb952516 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.859752:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262600/0x27274ba5bb952516 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.859765:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263400/0x27274ba5bb95251d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.859771:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263400/0x27274ba5bb95251d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.859777:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263400/0x27274ba5bb95251d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.859782:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1017263400 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789265296.859790:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263400/0x27274ba5bb95251d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.859796:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263400/0x27274ba5bb95251d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.859803:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8a101b706100) 00010000:00010000:0.0:1789265296.859806:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265296.859809:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263400/0x27274ba5bb95251d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.859814:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263400/0x27274ba5bb95251d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.859858:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263a00/0x27274ba5bb95250f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efedf expref: 30 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.859872:0:7934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262800/0x27274ba5bb952524 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efedf expref: 29 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.859878:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a1012931200) 00010000:00010000:0.0:1789265296.859881:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789265296.859883:0:7934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1017262800, rc 0) 00000100:00100000:0.0:1789265296.860183:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bee3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+29:10454:x1876180397503744:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 1485us (1724us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1789265296.860194:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 92 00000100:00100000:0.0:1789265296.869609:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265296.869698:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397503872 00000100:00100000:1.0:1789265296.869708:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397503872 00000100:00100000:1.0:1789265296.869762:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 93 00000100:00100000:1.0:1789265296.869771:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1041b70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+29:10454:x1876180397503872:12345-192.168.203.37@tcp:54:lfs.0 00010000:00010000:1.0:1789265296.869839:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb952532 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.869855:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262200/0x27274ba5bb9524d7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efeca expref: 29 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.869864:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb952532 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.869893:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262200/0x27274ba5bb9524d7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efeca expref: 29 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.869907:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262200/0x27274ba5bb9524d7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efeca expref: 29 pid: 5840 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265296.869920:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103bcc5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876180414299136:192.168.203.37@tcp:104: 00000100:00100000:1.0:1789265296.870004:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1004df9000 going to sleep for 11 seconds 00000100:00100000:0.0:1789265296.872680:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103bcc5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876180414299136:192.168.203.37@tcp:104: 00010000:00010000:0.0:1789265296.872713:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb952532 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265296.873947:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265296.874219:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397504128 00000100:00100000:2.0:1789265296.874230:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397504128 00000100:00100000:2.0:1789265296.874348:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 22 00000100:00100000:2.0:1789265296.874359:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1041b72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+30:5586:x1876180397504128:12345-192.168.203.37@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789265296.874679:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1041b72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+31:5586:x1876180397504128:12345-192.168.203.37@tcp:35:ldlm_bl.0 Request processed in 320us (736us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1789265296.874687:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 22 00000100:00100000:1.0:1789265296.877453:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265296.877542:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397504256 00000100:00100000:0.0:1789265296.877551:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397504256 00010000:00010000:0.0:1789265296.877601:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262200/0x27274ba5bb9524d7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efeca expref: 31 pid: 5840 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265296.877641:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 48 00000100:00100000:0.0:1789265296.877651:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bcc5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+31:2351:x1876180397504256:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265296.877666:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265296.877673:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262200/0x27274ba5bb9524d7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efeca expref: 31 pid: 5840 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.877689:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262200/0x27274ba5bb9524d7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efeca expref: 31 pid: 5840 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.877711:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262200/0x27274ba5bb9524d7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efeca expref: 31 pid: 5840 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.877727:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a1012931200) 00010000:00010000:0.0:1789265296.877732:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb952532 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.877741:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb952532 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.877749:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb952532 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.877923:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265296.877981:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bcc5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+30:2351:x1876180397504256:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 332us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265296.877989:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 48 00010000:00010000:1.0:1789265296.879278:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb952532 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.879305:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb952532 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.879348:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb952532 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.879355:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb952532 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.879363:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb952532 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.879370:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b597c00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789265296.879374:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb952532 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.879382:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb952532 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.879396:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a1012931200) 00010000:00010000:1.0:1789265296.879399:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789265296.879403:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb952532 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.879409:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb952532 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265296.879570:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1041b70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+29:10454:x1876180397503872:12345-192.168.203.37@tcp:54:lfs.0 Request processed in 9796us (9967us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265296.879579:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 93 00000100:00100000:0.0:1789265296.884472:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265296.884545:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397504512 00000100:00100000:1.0:1789265296.884555:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397504512 00000100:00100000:1.0:1789265296.884672:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 23 00000100:00100000:1.0:1789265296.884683:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1041b73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+29:10454:x1876180397504512:12345-192.168.203.37@tcp:35:lfs.0 00000100:00100000:1.0:1789265296.884926:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1041b73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+30:10454:x1876180397504512:12345-192.168.203.37@tcp:35:lfs.0 Request processed in 244us (462us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1789265296.884934:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 23 00000100:00100000:2.0:1789265296.967019:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265296.967342:0:11857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397504768 00000100:00100000:1.0:1789265296.967353:0:11857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397504768 00000100:00100000:1.0:1789265296.967420:0:11857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 94 00000100:00100000:1.0:1789265296.967430:0:11857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bee2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+30:10465:x1876180397504768:12345-192.168.203.37@tcp:101:cat.0 00010000:00010000:1.0:1789265296.967453:0:11857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265296.967473:0:11857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb952539 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99efee6 expref: -99 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.967548:0:11857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb952540 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.967563:0:11857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb952540 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.967573:0:11857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb952540 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.967597:0:11857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596e00/0x27274ba5bb952547 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.967603:0:11857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596e00/0x27274ba5bb952547 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.967625:0:11857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596e00/0x27274ba5bb952547 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.967882:0:11857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb95254e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.967891:0:11857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb95254e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.967899:0:11857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb95254e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265296.967909:0:11857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:1.0:1789265296.967997:0:11857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb952540 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.968004:0:11857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb952540 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.968010:0:11857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb952540 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.968016:0:11857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b597a00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789265296.968020:0:11857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb952540 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.968027:0:11857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb952540 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.968046:0:11857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a101b706300) 00010000:00010000:1.0:1789265296.968048:0:11857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265296.968059:0:11857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb952540 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.968066:0:11857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb952540 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.968428:0:11857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596e00/0x27274ba5bb952547 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.968437:0:11857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596e00/0x27274ba5bb952547 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.968443:0:11857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596e00/0x27274ba5bb952547 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.968449:0:11857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b596e00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789265296.968452:0:11857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596e00/0x27274ba5bb952547 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.968458:0:11857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596e00/0x27274ba5bb952547 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.968467:0:11857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8a101cdf4100) 00010000:00010000:1.0:1789265296.968470:0:11857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265296.968473:0:11857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596e00/0x27274ba5bb952547 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265296.968479:0:11857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596e00/0x27274ba5bb952547 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.975972:0:11857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb952539 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efee6 expref: 33 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.976007:0:11857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb95254e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efee6 expref: 32 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265296.976016:0:11857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a1012931200) 00010000:00010000:0.0:1789265296.976019:0:11857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789265296.976023:0:11857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a101b597200, rc 0) 00000100:00100000:0.0:1789265296.976125:0:11857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bee2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+32:10465:x1876180397504768:12345-192.168.203.37@tcp:101:cat.0 Request processed in 8695us (9114us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1789265296.976135:0:11857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 94 00000100:00100000:0.0:1789265296.985021:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265296.985113:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397505024 00000100:00100000:3.0:1789265296.985123:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397505024 00000100:00100000:3.0:1789265296.985223:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 24 00000100:00100000:3.0:1789265296.985233:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1041b70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+32:10465:x1876180397505024:12345-192.168.203.37@tcp:35:cat.0 00000100:00100000:3.0:1789265296.985452:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1041b70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+33:10465:x1876180397505024:12345-192.168.203.37@tcp:35:cat.0 Request processed in 219us (438us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1789265296.985460:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 24 00000100:00100000:2.0:1789265297.008269:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265297.008403:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397505280 00000100:00100000:0.0:1789265297.008414:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397505280 00000100:00100000:0.0:1789265297.008472:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 95 00000100:00100000:0.0:1789265297.008483:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bee2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+33:10466:x1876180397505280:12345-192.168.203.37@tcp:36:rm.0 00010000:00010000:0.0:1789265297.008535:0:7934:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789265297.008564:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb95254e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efee6 expref: 33 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.008606:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262800/0x27274ba5bb952524 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efedf expref: 32 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.008620:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596200/0x27274ba5bb9524ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efed1 expref: 31 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.008629:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a1012931200) 00010000:00010000:0.0:1789265297.008638:0:7934:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789265297.008658:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262a00/0x27274ba5bb95255c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.008670:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262a00/0x27274ba5bb95255c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.008678:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262a00/0x27274ba5bb95255c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.008692:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262200/0x27274ba5bb952563 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.008697:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262200/0x27274ba5bb952563 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.008703:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262200/0x27274ba5bb952563 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.008941:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262600/0x27274ba5bb95256a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.008951:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262600/0x27274ba5bb95256a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.008966:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262600/0x27274ba5bb95256a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789265297.009647:0:7934:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:0.0:1789265297.009658:0:7934:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 342814582207ns, next at 343814579541ns, rc = 0 00010000:00010000:0.0:1789265297.009716:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263400/0x27274ba5bb952571 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.009726:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263400/0x27274ba5bb952571 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.009734:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263400/0x27274ba5bb952571 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.009741:0:7934:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263400/0x27274ba5bb952571 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.009746:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263400/0x27274ba5bb952571 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.009752:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263400/0x27274ba5bb952571 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.009780:0:7934:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789265297.009799:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262600/0x27274ba5bb95256a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.009806:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262600/0x27274ba5bb95256a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.009812:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262600/0x27274ba5bb95256a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.009826:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1017262600 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789265297.009830:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262600/0x27274ba5bb95256a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.009838:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262600/0x27274ba5bb95256a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.009848:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a101b706c00) 00010000:00010000:0.0:1789265297.009851:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789265297.009855:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262600/0x27274ba5bb95256a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.009861:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262600/0x27274ba5bb95256a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.009878:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262a00/0x27274ba5bb95255c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.009884:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262a00/0x27274ba5bb95255c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.009890:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262a00/0x27274ba5bb95255c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.009894:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1017262a00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789265297.009897:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262a00/0x27274ba5bb95255c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.009904:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262a00/0x27274ba5bb95255c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.009921:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a101b706300) 00010000:00010000:0.0:1789265297.009923:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265297.009926:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262a00/0x27274ba5bb95255c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.009932:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262a00/0x27274ba5bb95255c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789265297.009942:0:7934:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000564f94fb reply state 000000005b56bcc7 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262200/0x27274ba5bb952563 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265297.009951:0:7934:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789265297.012956:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bee2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+32:10466:x1876180397505280:12345-192.168.203.37@tcp:36:rm.0 Request processed in 4462us (4683us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1789265297.012970:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 95 00010000:00010000:1.0:1789265297.016232:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265297.016248:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263400/0x27274ba5bb952571 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265297.016279:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1017263400 already unused, calling callback (ffffffffc1581350) 00010000:00010000:1.0:1789265297.016284:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263400/0x27274ba5bb952571 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265297.016293:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263400/0x27274ba5bb952571 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265297.016312:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a101b706c00) 00010000:00010000:1.0:1789265297.016315:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789265297.016320:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263400/0x27274ba5bb952571 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265297.016326:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263400/0x27274ba5bb952571 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265297.016350:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265297.016352:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265297.016353:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265297.018762:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262200/0x27274ba5bb952563 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265297.018784:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262200/0x27274ba5bb952563 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265297.018792:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262200/0x27274ba5bb952563 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265297.018798:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1017262200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789265297.018804:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262200/0x27274ba5bb952563 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265297.018833:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262200/0x27274ba5bb952563 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265297.018857:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8a101b706100) 00010000:00010000:3.0:1789265297.018860:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265297.018865:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262200/0x27274ba5bb952563 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265297.018872:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262200/0x27274ba5bb952563 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265297.080297:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265297.080432:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397505536 00000100:00100000:1.0:1789265297.080445:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397505536 00000100:00100000:1.0:1789265297.080516:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 96 00000100:00100000:1.0:1789265297.080527:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bee3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+31:10472:x1876180397505536:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:1.0:1789265297.080560:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265297.080597:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596e00/0x27274ba5bb952578 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99efeed expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265297.080754:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb95257f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265297.080771:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb95257f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265297.080804:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb95257f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265297.080822:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb952586 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265297.080830:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb952586 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265297.080836:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb952586 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789265297.081592:0:5842:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:1.0:1789265297.081804:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596400/0x27274ba5bb95258d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265297.081817:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596400/0x27274ba5bb95258d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265297.081827:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596400/0x27274ba5bb95258d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265297.081868:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb95257f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265297.081875:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb95257f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265297.081882:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb95257f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265297.081889:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b597a00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789265297.081902:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb95257f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265297.081910:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb95257f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265297.081925:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a101b706300) 00010000:00010000:1.0:1789265297.081929:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265297.081934:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb95257f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265297.081941:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb95257f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789265297.081956:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000d2a4e31 reply state 00000000a8af243b transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb952586 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265297.081967:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789265297.082007:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596e00/0x27274ba5bb952578 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efeed expref: 34 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265297.082022:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596400/0x27274ba5bb95258d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efeed expref: 33 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265297.082029:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a101cdf4e00) 00010000:00010000:1.0:1789265297.082032:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789265297.082034:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a101b596400, rc 0) 00000100:00100000:1.0:1789265297.082206:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bee3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+34:10472:x1876180397505536:12345-192.168.203.37@tcp:101:bash.0 Request processed in 1680us (1921us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1789265297.082215:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 96 00010000:00010000:3.0:1789265297.084603:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb952586 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265297.084626:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb952586 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265297.084634:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb952586 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265297.084640:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b597800 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789265297.084646:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb952586 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265297.084655:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb952586 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265297.084676:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8a101cdf4100) 00010000:00010000:3.0:1789265297.084679:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265297.084684:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb952586 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265297.084709:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb952586 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265297.090761:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265297.092460:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397505664 00000100:00100000:0.0:1789265297.092483:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397505664 00000100:00100000:0.0:1789265297.092591:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 34 00000100:00100000:0.0:1789265297.092604:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bee1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+7:2351:x1876180397505664:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:0.0:1789265297.092638:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265297.092671:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f580afaf/0x27274ba5bb95259b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99efef4 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789265297.092705:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789265297.092729:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=342s v=(0 0) 00010000:00010000:0.0:1789265297.092734:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265297.092746:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f580afaf/0x27274ba5bb95259b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efef4 expref: 8 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.092805:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f580afaf/0x27274ba5bb95259b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efef4 expref: 8 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.092823:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1017262600, rc 0) 00000100:00100000:0.0:1789265297.092920:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bee1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+8:2351:x1876180397505664:12345-192.168.203.37@tcp:101:bash.0 Request processed in 318us (2173us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265297.092928:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 34 00000100:00100000:0.0:1789265297.099902:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265297.103071:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397505792 00000100:00100000:3.0:1789265297.103106:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397505792 00000100:00100000:3.0:1789265297.103597:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 35 00000100:00100000:3.0:1789265297.103678:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1034afaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+8:10472:x1876180397505792:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:3.0:1789265297.103705:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265297.103729:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b256b2a8/0x27274ba5bb9525a2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99efefb expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265297.103775:0:6685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f580afaf/0x27274ba5bb95259b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efef4 expref: 9 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265297.103786:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265297.103791:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265297.103796:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b256b2a8/0x27274ba5bb9525a2 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efefb expref: 9 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265297.103839:0:6685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f580afaf/0x27274ba5bb95259b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efef4 expref: 9 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265297.103858:0:6685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f580afaf/0x27274ba5bb95259b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efef4 expref: 9 pid: 6682 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265297.103875:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103fb31180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6685:1876180414299264:192.168.203.37@tcp:104: 00000100:00100000:2.0:1789265297.106197:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103bb47c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789265297.120718:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265297.121357:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397505920 00000100:00100000:3.0:1789265297.121372:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397505920 00010000:00010000:3.0:1789265297.121430:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f580afaf/0x27274ba5bb95259b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efef4 expref: 10 pid: 6682 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265297.121435:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103fb31180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6685:1876180414299264:192.168.203.37@tcp:104: 00010000:00010000:2.0:1789265297.121475:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b256b2a8/0x27274ba5bb9525a2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efefb expref: 10 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265297.121481:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 49 00000100:00100000:3.0:1789265297.121490:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10118e6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+10:2351:x1876180397505920:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265297.121496:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fae9000, rc 0) 00010000:00010000:3.0:1789265297.121519:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265297.121546:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f580afaf/0x27274ba5bb95259b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efef4 expref: 10 pid: 6682 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265297.121562:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f580afaf/0x27274ba5bb95259b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efef4 expref: 10 pid: 6682 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265297.121566:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1034afaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+10:10472:x1876180397505792:12345-192.168.203.37@tcp:101:bash.0 Request processed in 17960us (21679us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265297.121575:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 35 00010000:00010000:3.0:1789265297.121602:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f580afaf/0x27274ba5bb95259b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efef4 expref: 9 pid: 6682 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265297.121628:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265297.121633:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265297.121642:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b256b2a8/0x27274ba5bb9525a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efefb expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265297.121652:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b256b2a8/0x27274ba5bb9525a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efefb expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265297.121699:0:5827:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b256b2a8/0x27274ba5bb9525a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efefb expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265297.121738:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103fb31880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5827:1876180414299392:192.168.203.37@tcp:105: 00000100:00100000:3.0:1789265297.121807:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103bb470c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265297.134976:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265297.135788:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397506176 00000100:00100000:1.0:1789265297.135804:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397506176 00000100:00100000:1.0:1789265297.136019:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 25 00000100:00100000:1.0:1789265297.136033:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1034af9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+33:10472:x1876180397506176:12345-192.168.203.37@tcp:35:bash.0 00000100:00100000:3.0:1789265297.136220:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103fb31880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5827:1876180414299392:192.168.203.37@tcp:105: 00010000:00010000:3.0:1789265297.136252:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265297.136441:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10118e6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+8:2351:x1876180397505920:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 14949us (15736us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265297.136452:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 49 00000100:00100000:1.0:1789265297.136528:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1034af9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+34:10472:x1876180397506176:12345-192.168.203.37@tcp:35:bash.0 Request processed in 496us (1566us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1789265297.136537:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 25 00000100:00100000:2.0:1789265297.268960:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265297.269108:0:11857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397506304 00000100:00100000:0.0:1789265297.269121:0:11857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397506304 00000100:00100000:0.0:1789265297.269206:0:11857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 97 00000100:00100000:0.0:1789265297.269220:0:11857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bee0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+34:10488:x1876180397506304:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:0.0:1789265297.269251:0:11857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265297.269280:0:11857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263a00/0x27274ba5bb9525a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99eff02 expref: -99 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.269365:0:11857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262600/0x27274ba5bb9525b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.269382:0:11857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262600/0x27274ba5bb9525b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.269399:0:11857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262600/0x27274ba5bb9525b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265297.269443:0:11857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1789265297.269463:0:11857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789265297.269487:0:11857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262600/0x27274ba5bb9525b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.269516:0:11857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263a00/0x27274ba5bb9525a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff02 expref: 36 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.269540:0:11857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262600/0x27274ba5bb9525b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff02 expref: 35 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.269551:0:11857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a101b706300) 00010000:00010000:0.0:1789265297.269554:0:11857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789265297.269557:0:11857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1017262600, rc 0) 00000100:00100000:0.0:1789265297.270207:0:11857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bee0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+35:10488:x1876180397506304:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 436us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265297.270219:0:11857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 97 00000100:00100000:0.0:1789265297.276214:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265297.278652:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397506560 00000100:00100000:1.0:1789265297.278674:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397506560 00000100:00100000:1.0:1789265297.278778:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 98 00000100:00100000:1.0:1789265297.278791:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1034af8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+35:10488:x1876180397506560:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:1.0:1789265297.278818:0:7934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265297.278845:0:7934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb9525b7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99eff09 expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265297.279303:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb9525be lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265297.279323:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb9525be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265297.279337:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb9525be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265297.279354:0:7934:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1789265297.279531:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb9525b7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff09 expref: 38 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265297.279684:0:7934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb9525be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff09 expref: 37 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265297.279695:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a101cdf4e00) 00010000:00010000:1.0:1789265297.279698:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789265297.279702:0:7934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a101b597a00, rc 0) 00000100:00100000:1.0:1789265297.279804:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1034af8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+37:10488:x1876180397506560:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 1015us (3862us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1789265297.279814:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 98 00000100:00100000:1.0:1789265297.284817:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265297.284924:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265297.285111:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397506944 00000100:00100000:3.0:1789265297.285125:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397506944 00000100:00100000:3.0:1789265297.285224:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 6 00000100:00100000:3.0:1789265297.285236:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bcc7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+37:2351:x1876180397506944:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265297.285257:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265297.285290:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb9525be lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff09 expref: 37 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265297.285312:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a101cdf4e00) 00010000:00010000:3.0:1789265297.285317:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265297.285395:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bcc7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+36:2351:x1876180397506944:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 161us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265297.285403:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 6 00000100:00100000:2.0:1789265297.286681:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397506816 00000100:00100000:2.0:1789265297.286696:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397506816 00000100:00100000:2.0:1789265297.286795:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 99 00000100:00100000:2.0:1789265297.286806:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bcc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+36:10488:x1876180397506816:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:2.0:1789265297.286835:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265297.286860:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb9525cc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99eff10 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265297.287195:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb9525d3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265297.287213:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb9525d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265297.287227:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb9525d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265297.287242:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789265297.287395:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb9525cc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff10 expref: 39 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265297.287416:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb9525d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff10 expref: 38 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265297.287425:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a101cdf4e00) 00010000:00010000:2.0:1789265297.287428:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789265297.287431:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fad6000, rc 0) 00000100:00100000:2.0:1789265297.287512:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bcc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+38:10488:x1876180397506816:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 709us (2710us total) trans 4294967380 rc 0/0 00000100:00100000:2.0:1789265297.287520:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 99 00000100:00100000:1.0:1789265297.292473:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265297.292778:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397507072 00000100:00100000:0.0:1789265297.292792:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397507072 00000100:00100000:0.0:1789265297.292911:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 36 00000100:00100000:0.0:1789265297.292923:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1016dd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+8:2351:x1876180397507072:12345-192.168.203.37@tcp:1:lfs.0 00010000:00010000:0.0:1789265297.292986:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5177f16/0x27274ba5bb9525e1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.293022:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b256b2a8/0x27274ba5bb9525a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efefb expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.293033:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789265297.293056:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789265297.293061:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5177f16/0x27274ba5bb9525e1 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.293156:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b256b2a8/0x27274ba5bb9525a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efefb expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.293176:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b256b2a8/0x27274ba5bb9525a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efefb expref: 8 pid: 6685 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265297.293196:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1034afa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6682:1876180414299520:192.168.203.37@tcp:104: 00000100:00100000:0.0:1789265297.293309:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10031cb780 going to sleep for 11 seconds 00000100:00100000:2.0:1789265297.300498:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265297.300590:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397507200 00000100:00100000:0.0:1789265297.300602:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397507200 00002000:00100000:0.0:1789265297.300668:0:6689:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8a103bee0700 x1876180397507200/t0(0) o4->4b820fcb-1bab-4b78-bfa4-355c22a09cf8@192.168.203.37@tcp:623/0 lens 504/0 e 0 to 0 dl 1789265308 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789265297.300681:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a103bee0700 with x1876180397507200 ext(0->8) 00010000:00010000:0.0:1789265297.300693:0:6689:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000b256b2a8/0x27274ba5bb9525a2 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efefb expref: 9 pid: 6685 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.300716:0:6689:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000b256b2a8/0x27274ba5bb9525a2 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efefb expref: 9 pid: 6685 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789265297.300725:0:6689:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8a103bee0700 00000100:00100000:0.0:1789265297.300776:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 1 00000100:00100000:0.0:1789265297.300787:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bee0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+9:2351:x1876180397507200:12345-192.168.203.37@tcp:4:lfs.0 00000100:00100000:0.0:1789265297.302231:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bee0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+11:2351:x1876180397507200:12345-192.168.203.37@tcp:4:lfs.0 Request processed in 1435us (1736us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1789265297.302246:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 1 00002000:00100000:0.0:1789265297.302258:0:6689:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8a103bee0700 x1876180397507200/t4294967302(0) o4->4b820fcb-1bab-4b78-bfa4-355c22a09cf8@192.168.203.37@tcp:623/0 lens 504/448 e 0 to 0 dl 1789265308 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789265297.302269:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a103bee0700 with x1876180397507200 ext(0->8) 00010000:00010000:0.0:1789265297.302279:0:6689:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000b256b2a8/0x27274ba5bb9525a2 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efefb expref: 11 pid: 6685 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.302302:0:6689:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000b256b2a8/0x27274ba5bb9525a2 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efefb expref: 11 pid: 6685 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789265297.302311:0:6689:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8a103bee0700 00000100:00100000:3.0:1789265297.304983:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1034afa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6682:1876180414299520:192.168.203.37@tcp:104: 00010000:00010000:3.0:1789265297.305041:0:6682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c5177f16/0x27274ba5bb9525e1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265297.305717:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265297.305822:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397507328 00000100:00100000:0.0:1789265297.305833:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397507328 00010000:00010000:0.0:1789265297.305882:0:8490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b256b2a8/0x27274ba5bb9525a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efefb expref: 11 pid: 6685 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265297.305932:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 50 00000100:00100000:0.0:1789265297.305944:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bcc6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+11:2348:x1876180397507328:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265297.305965:0:8490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789265297.306476:0:8490:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789265297.306482:0:8490:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789265297 00002000:00010000:0.0:1789265297.306485:0:8490:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789265297 00002000:00010000:0.0:1789265297.306488:0:8490:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1789265297 00010000:00010000:0.0:1789265297.306740:0:8490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b256b2a8/0x27274ba5bb9525a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efefb expref: 11 pid: 6685 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.306761:0:8490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b256b2a8/0x27274ba5bb9525a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efefb expref: 11 pid: 6685 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.306796:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b256b2a8/0x27274ba5bb9525a2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efefb expref: 11 pid: 6685 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.306818:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789265297.306823:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789265297.306830:0:8490:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c5177f16/0x27274ba5bb9525e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.306842:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5177f16/0x27274ba5bb9525e1 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.306937:0:8490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789265297.307135:0:6682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c5177f16/0x27274ba5bb9525e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265297.307155:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c5177f16/0x27274ba5bb9525e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265297.307190:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5177f16/0x27274ba5bb9525e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265297.307199:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c5177f16/0x27274ba5bb9525e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265297.307209:0:6682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c5177f16/0x27274ba5bb9525e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265297.307216:0:6682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1017263a00 already unused, calling callback (ffffffffc1581350) 00010000:00010000:3.0:1789265297.307221:0:6682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5177f16/0x27274ba5bb9525e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265297.307232:0:6682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5177f16/0x27274ba5bb9525e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265297.307246:0:6682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c5177f16/0x27274ba5bb9525e1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265297.307270:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5177f16/0x27274ba5bb9525e1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265297.307358:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1016dd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+10:2351:x1876180397507072:12345-192.168.203.37@tcp:1:lfs.0 Request processed in 14436us (14898us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265297.307368:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 36 00000100:00100000:3.0:1789265297.310643:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265297.310852:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397507584 00000100:00100000:2.0:1789265297.310866:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397507584 00000100:00100000:2.0:1789265297.310941:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 26 00000100:00100000:2.0:1789265297.310952:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1010a42c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+38:10488:x1876180397507584:12345-192.168.203.37@tcp:35:lfs.0 00000004:00010000:2.0:1789265297.311063:0:5843:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb9525d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff10 expref: 38 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789265297.311475:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:2.0:1789265297.311525:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:2.0:1789265297.312206:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00010000:00010000:2.0:1789265297.312268:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6400/0x27274ba5bb9525e8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265297.312289:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596400/0x27274ba5bb95258d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efeed expref: 42 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265297.312301:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6400/0x27274ba5bb9525e8 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265297.312350:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596400/0x27274ba5bb95258d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efeed expref: 42 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265297.312371:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596400/0x27274ba5bb95258d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efeed expref: 42 pid: 5842 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265297.312389:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103bee1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5843:1876180414299648:192.168.203.37@tcp:104: 00000100:00100000:1.0:1789265297.312404:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bcc6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+9:2348:x1876180397507328:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 6457us (6684us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265297.312417:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 50 00000100:00100000:2.0:1789265297.312473:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a102ec330c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265297.315860:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103bee1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5843:1876180414299648:192.168.203.37@tcp:104: 00010000:00010000:3.0:1789265297.315900:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6400/0x27274ba5bb9525e8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265297.317450:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265297.317594:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397507712 00000100:00100000:0.0:1789265297.317609:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397507712 00010000:00010000:0.0:1789265297.317680:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596400/0x27274ba5bb95258d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efeed expref: 43 pid: 5842 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265297.317722:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 51 00000100:00100000:0.0:1789265297.317734:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103fb31880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+43:2350:x1876180397507712:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265297.317753:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265297.317761:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596400/0x27274ba5bb95258d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efeed expref: 43 pid: 5842 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.317797:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596400/0x27274ba5bb95258d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efeed expref: 43 pid: 5842 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.317825:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596400/0x27274ba5bb95258d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efeed expref: 43 pid: 5842 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.317847:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a101cdf4e00) 00010000:00010000:0.0:1789265297.317854:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6400/0x27274ba5bb9525e8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.317865:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6400/0x27274ba5bb9525e8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.317874:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6400/0x27274ba5bb9525e8 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.317910:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265297.317990:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103fb31880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+42:2350:x1876180397507712:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 258us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265297.317998:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 51 00010000:00010000:3.0:1789265297.318210:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6400/0x27274ba5bb9525e8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265297.318219:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6400/0x27274ba5bb9525e8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789265297.318392:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000001:00080000:3.0:1789265297.318646:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:3.0:1789265297.318931:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103fb33b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5843:1876180414299776:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789265297.319496:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265297.319549:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103bb47900 going to sleep for 11 seconds 00000100:00100000:0.0:1789265297.319663:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414299776 00000100:00100000:0.0:1789265297.319674:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414299776 00000100:00100000:0.0:1789265297.319750:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789265297.319761:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103fb33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5843:x1876180414299776:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789265297.319865:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103fb33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5843:x1876180414299776:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 106us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265297.319874:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1789265297.320840:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265297.320909:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103fb33b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5843:1876180414299776:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789265297.322508:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:3.0:1789265297.322846:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103fb33b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5843:1876180414299904:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789265297.322934:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265297.323116:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103bb47180 going to sleep for 11 seconds 00000100:00100000:0.0:1789265297.324717:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414299904 00000100:00100000:0.0:1789265297.324737:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414299904 00000100:00100000:1.0:1789265297.325256:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789265297.325271:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103fb32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5843:x1876180414299904:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789265297.325609:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103fb32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5843:x1876180414299904:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 342us (2674us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1789265297.325618:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789265297.325745:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103fb33b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5843:1876180414299904:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789265297.325836:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:3.0:1789265297.325897:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6400/0x27274ba5bb9525e8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265297.325911:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6400/0x27274ba5bb9525e8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265297.325919:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6400/0x27274ba5bb9525e8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265297.325927:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad6400 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789265297.325932:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6400/0x27274ba5bb9525e8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265297.325941:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6400/0x27274ba5bb9525e8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265297.325961:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a101cdf4e00) 00010000:00010000:3.0:1789265297.325965:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789265297.325970:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6400/0x27274ba5bb9525e8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265297.325977:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6400/0x27274ba5bb9525e8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789265297.326274:0:5843:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789265297.326460:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:3.0:1789265297.326487:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 343131411667ns, next at 344131408928ns, rc = 0 00000001:00080000:3.0:1789265297.326495:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:3.0:1789265297.326533:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a101cdf4e00) 00010000:00010000:3.0:1789265297.326536:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789265297.326544:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb9525d3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff10 expref: 46 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265297.326690:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1010a42c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+45:10488:x1876180397507584:12345-192.168.203.37@tcp:35:lfs.0 Request processed in 15739us (16060us total) trans 4294967389 rc 0/0 00000100:00100000:3.0:1789265297.326701:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 26 00000020:00080000:3.0:1789265297.326705:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1789265297.329718:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265297.329886:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397507840 00000100:00100000:2.0:1789265297.329899:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397507840 00000100:00100000:2.0:1789265297.329976:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 100 00000100:00100000:2.0:1789265297.329988:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103fb32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+45:10488:x1876180397507840:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:2.0:1789265297.330024:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265297.330068:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb9525ef lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99eff17 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265297.330178:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb9525ef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff17 expref: 46 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265297.330195:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb9525ef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff17 expref: 46 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265297.330218:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a1012931800) 00010000:00010000:2.0:1789265297.330222:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789265297.330225:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fad6200, rc 0) 00000100:00100000:2.0:1789265297.330299:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103fb32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+46:10488:x1876180397507840:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 313us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265297.330307:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 100 00000100:00100000:2.0:1789265297.333626:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265297.333753:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397508096 00000100:00100000:3.0:1789265297.333766:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397508096 00000100:00100000:3.0:1789265297.333840:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 27 00000100:00100000:3.0:1789265297.333851:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bee3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+46:10488:x1876180397508096:12345-192.168.203.37@tcp:35:lfs.0 00000100:00100000:3.0:1789265297.334197:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bee3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+47:10488:x1876180397508096:12345-192.168.203.37@tcp:35:lfs.0 Request processed in 346us (584us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1789265297.334205:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 27 00000100:00100000:2.0:1789265297.413771:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265297.414059:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397508224 00000100:00100000:1.0:1789265297.414102:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397508224 00000100:00100000:1.0:1789265297.414197:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 101 00000100:00100000:1.0:1789265297.414210:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bee2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+47:10498:x1876180397508224:12345-192.168.203.37@tcp:34:lfs.0 00010000:00010000:1.0:1789265297.414343:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb9525f6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265297.414364:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb9525f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265297.414378:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb9525f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265297.414467:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb9525fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265297.414478:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb9525fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265297.414485:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb9525fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265297.414609:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596200/0x27274ba5bb952604 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265297.414619:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596200/0x27274ba5bb952604 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265297.414627:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596200/0x27274ba5bb952604 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789265297.414682:0:7934:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596200/0x27274ba5bb952604 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265297.414698:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb9525f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265297.414717:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb9525f6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265297.414724:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb9525f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265297.414731:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b597200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789265297.414736:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb9525f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265297.414745:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb9525f6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265297.414759:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a101b706300) 00010000:00010000:1.0:1789265297.414762:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265297.414767:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb9525f6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265297.414773:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb9525f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265297.414788:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb9525fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265297.414794:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb9525fd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265297.414800:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb9525fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265297.414805:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b597c00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789265297.414817:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb9525fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265297.414824:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb9525fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265297.414831:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8a101cdf4000) 00010000:00010000:1.0:1789265297.414834:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265297.414837:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb9525fd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265297.414843:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb9525fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265297.414860:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596200/0x27274ba5bb952604 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265297.414866:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596200/0x27274ba5bb952604 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265297.414872:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596200/0x27274ba5bb952604 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265297.414877:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b596200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789265297.414881:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596200/0x27274ba5bb952604 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265297.414887:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596200/0x27274ba5bb952604 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265297.414893:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a1012931800) 00010000:00010000:1.0:1789265297.414895:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265297.415220:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596200/0x27274ba5bb952604 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265297.415227:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596200/0x27274ba5bb952604 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265297.415349:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bee2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+47:10498:x1876180397508224:12345-192.168.203.37@tcp:34:lfs.0 Request processed in 1137us (1587us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265297.415361:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 101 00000100:00100000:1.0:1789265297.473839:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265297.474000:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397508480 00000100:00100000:2.0:1789265297.474013:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397508480 00000100:00100000:2.0:1789265297.474203:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 102 00000100:00100000:2.0:1789265297.474215:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bcc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+47:10501:x1876180397508480:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:2.0:1789265297.474243:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265297.474268:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb95260b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99eff1e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265297.474359:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb952612 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265297.474378:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb952612 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265297.474407:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb952612 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265297.474426:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7600/0x27274ba5bb952619 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265297.474434:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7600/0x27274ba5bb952619 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265297.474441:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7600/0x27274ba5bb952619 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265297.474604:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952620 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265297.474613:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952620 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265297.474621:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952620 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265297.474632:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789265297.474748:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb952612 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265297.474755:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb952612 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265297.474763:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb952612 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265297.474768:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad7000 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789265297.474782:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb952612 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265297.474790:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb952612 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265297.474805:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a101b706300) 00010000:00010000:2.0:1789265297.474809:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265297.474815:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb952612 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265297.474823:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb952612 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265297.474838:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7600/0x27274ba5bb952619 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265297.474846:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7600/0x27274ba5bb952619 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265297.474853:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7600/0x27274ba5bb952619 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265297.474858:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad7600 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789265297.474861:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7600/0x27274ba5bb952619 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265297.474866:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7600/0x27274ba5bb952619 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265297.474874:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8a1012931300) 00010000:00010000:2.0:1789265297.474877:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265297.474885:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7600/0x27274ba5bb952619 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265297.474892:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7600/0x27274ba5bb952619 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265297.474942:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb95260b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff1e expref: 50 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265297.474958:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952620 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff1e expref: 49 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265297.474965:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a1012931800) 00010000:00010000:2.0:1789265297.474968:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789265297.474970:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fad6a00, rc 0) 00000100:00100000:2.0:1789265297.488582:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bcc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+49:10501:x1876180397508480:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 14348us (14738us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1789265297.488599:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 102 00000100:00100000:3.0:1789265297.496291:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265297.496422:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397508608 00000100:00100000:0.0:1789265297.496436:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397508608 00000100:00100000:0.0:1789265297.496519:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 103 00000100:00100000:0.0:1789265297.496533:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103fb33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+49:10501:x1876180397508608:12345-192.168.203.37@tcp:54:lfs.0 00010000:00010000:0.0:1789265297.496637:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262a00/0x27274ba5bb95262e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.496660:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262a00/0x27274ba5bb95262e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.496677:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262a00/0x27274ba5bb95262e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.496718:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262a00/0x27274ba5bb95262e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.496727:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262a00/0x27274ba5bb95262e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.496735:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262a00/0x27274ba5bb95262e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.496743:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1017262a00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789265297.496748:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262a00/0x27274ba5bb95262e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.496757:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262a00/0x27274ba5bb95262e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.496770:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a1012931800) 00010000:00010000:0.0:1789265297.496791:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789265297.496797:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262a00/0x27274ba5bb95262e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.496804:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262a00/0x27274ba5bb95262e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265297.497049:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103fb33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+49:10501:x1876180397508608:12345-192.168.203.37@tcp:54:lfs.0 Request processed in 517us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265297.497057:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 103 00000100:00100000:3.0:1789265297.510554:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265297.510751:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397508864 00000100:00100000:1.0:1789265297.510765:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397508864 00000100:00100000:1.0:1789265297.510835:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 28 00000100:00100000:1.0:1789265297.510847:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103fb31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+49:10501:x1876180397508864:12345-192.168.203.37@tcp:35:lfs.0 00000100:00100000:1.0:1789265297.511235:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103fb31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+50:10501:x1876180397508864:12345-192.168.203.37@tcp:35:lfs.0 Request processed in 389us (695us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1789265297.511244:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 28 00000100:00100000:0.0:1789265297.584975:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265297.585118:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397509120 00000100:00100000:1.0:1789265297.585132:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397509120 00000100:00100000:1.0:1789265297.585244:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 104 00000100:00100000:1.0:1789265297.585257:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1034af8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+50:10511:x1876180397509120:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:1.0:1789265297.585291:0:7934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265297.585295:0:7934:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789265297.585330:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262600/0x27274ba5bb9525b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff02 expref: 50 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265297.585353:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a101b706300) 00010000:00010000:1.0:1789265297.585359:0:7934:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789265297.585395:0:7934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596200/0x27274ba5bb952635 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99eff25 expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265297.585520:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb95263c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265297.585536:0:7934:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952620 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff1e expref: 50 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265297.585546:0:7934:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb95263c lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265297.585588:0:7934:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952620 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff1e expref: 50 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265297.585607:0:7934:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952620 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff1e expref: 50 pid: 5841 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265297.585624:0:7934:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103bcc7480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7934:1876180414300032:192.168.203.37@tcp:104: 00000100:00100000:1.0:1789265297.585756:0:7934:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1004df9180 going to sleep for 11 seconds 00000100:00100000:1.0:1789265297.599621:0:7934:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103bcc7480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7934:1876180414300032:192.168.203.37@tcp:104: 00010000:00010000:1.0:1789265297.599666:0:7934:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb95263c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265297.602212:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265297.604175:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397509248 00000100:00100000:3.0:1789265297.604196:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397509248 00010000:00010000:3.0:1789265297.604267:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952620 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff1e expref: 51 pid: 5841 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265297.604384:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 52 00000100:00100000:3.0:1789265297.604397:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1034af8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+51:2350:x1876180397509248:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265297.604434:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265297.604443:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952620 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff1e expref: 51 pid: 5841 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265297.604463:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952620 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff1e expref: 51 pid: 5841 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265297.604491:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952620 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff1e expref: 51 pid: 5841 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265297.604514:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a1012931800) 00010000:00010000:3.0:1789265297.604519:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb95263c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265297.604530:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb95263c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265297.604539:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb95263c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265297.605847:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265297.605956:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1034af8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+50:2350:x1876180397509248:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 1553us (3752us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265297.605971:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 52 00010000:00010000:0.0:1789265297.607741:0:7934:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb95263c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.607763:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb95263c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265297.607792:0:7934:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1789265297.608024:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596200/0x27274ba5bb952635 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff25 expref: 51 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.608050:0:7934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb95263c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff25 expref: 50 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.608061:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a1012931800) 00010000:00010000:0.0:1789265297.608065:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789265297.608069:0:7934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a101b597c00, rc 0) 00000100:00100000:0.0:1789265297.608198:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1034af8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+50:10511:x1876180397509120:12345-192.168.203.37@tcp:101:bash.0 Request processed in 22942us (23238us total) trans 4294967393 rc 0/0 00000100:00100000:0.0:1789265297.608231:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 104 00000100:00100000:3.0:1789265297.619901:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265297.622447:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397509504 00000100:00100000:2.0:1789265297.622471:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397509504 00000100:00100000:2.0:1789265297.622585:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 105 00000100:00100000:2.0:1789265297.622599:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103fb30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+50:10511:x1876180397509504:12345-192.168.203.37@tcp:36:bash.0 00010000:00010000:2.0:1789265297.622941:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb95264a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265297.622964:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb95264a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265297.622978:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb95264a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789265297.623150:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967394 00000004:00010000:2.0:1789265297.623181:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dcc26e77 reply state 00000000ce70387d transno 4294967395 ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb95264a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265297.623191:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789265297.623327:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103fb30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+53:10511:x1876180397509504:12345-192.168.203.37@tcp:36:bash.0 Request processed in 729us (3440us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1789265297.623335:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 105 00000020:00080000:2.0:1789265297.623341:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789265297.626564:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb95264a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265297.626588:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb95264a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265297.626613:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb95264a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265297.626619:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad6c00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789265297.626625:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb95264a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265297.626634:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb95264a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265297.626656:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a1012931800) 00010000:00010000:3.0:1789265297.626660:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265297.626665:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb95264a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265297.626672:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb95264a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265297.632608:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265297.632840:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397509632 00000100:00100000:0.0:1789265297.632856:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397509632 00000100:00100000:0.0:1789265297.632942:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 106 00000100:00100000:0.0:1789265297.632955:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103fb32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+52:10511:x1876180397509632:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:0.0:1789265297.632990:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265297.633017:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262200/0x27274ba5bb952651 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99eff2c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.633229:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263400/0x27274ba5bb952658 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.633249:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb95263c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff25 expref: 53 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.633259:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263400/0x27274ba5bb952658 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.633306:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb95263c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff25 expref: 53 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.633325:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb95263c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff25 expref: 53 pid: 7934 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265297.633341:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1034af9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876180414300160:192.168.203.37@tcp:104: 00000100:00100000:0.0:1789265297.633461:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10031cb540 going to sleep for 11 seconds 00000100:00100000:0.0:1789265297.645006:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1034af9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876180414300160:192.168.203.37@tcp:104: 00010000:00010000:0.0:1789265297.645119:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263400/0x27274ba5bb952658 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265297.650735:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265297.651014:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397509760 00000100:00100000:0.0:1789265297.651029:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397509760 00010000:00010000:0.0:1789265297.651267:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb95263c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff25 expref: 54 pid: 7934 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265297.651320:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 53 00000100:00100000:0.0:1789265297.651333:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103fb31500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+54:2349:x1876180397509760:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265297.651351:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265297.651360:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb95263c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff25 expref: 54 pid: 7934 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.651379:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb95263c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff25 expref: 54 pid: 7934 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.651406:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb95263c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff25 expref: 54 pid: 7934 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.651426:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a1012931800) 00010000:00010000:0.0:1789265297.651432:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263400/0x27274ba5bb952658 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.651443:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263400/0x27274ba5bb952658 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.651452:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263400/0x27274ba5bb952658 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.651506:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265297.651709:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103fb31500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+53:2349:x1876180397509760:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 378us (989us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265297.651719:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 53 00010000:00010000:3.0:1789265297.652273:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263400/0x27274ba5bb952658 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265297.652285:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263400/0x27274ba5bb952658 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265297.652349:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1789265297.652354:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789265297.652379:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263400/0x27274ba5bb952658 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265297.652443:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262200/0x27274ba5bb952651 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff2c expref: 53 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265297.652463:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263400/0x27274ba5bb952658 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff2c expref: 52 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265297.652471:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a1012931800) 00010000:00010000:3.0:1789265297.652474:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789265297.652477:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1017263400, rc 0) 00000100:00100000:3.0:1789265297.652590:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103fb32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+52:10511:x1876180397509632:12345-192.168.203.37@tcp:101:bash.0 Request processed in 19637us (19996us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265297.652598:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 106 00000100:00100000:3.0:1789265297.669016:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265297.669203:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397510016 00000100:00100000:1.0:1789265297.669217:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397510016 00000100:00100000:1.0:1789265297.669297:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 29 00000100:00100000:1.0:1789265297.669311:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103fb30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+52:10511:x1876180397510016:12345-192.168.203.37@tcp:35:bash.0 00000100:00100000:1.0:1789265297.669661:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103fb30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+53:10511:x1876180397510016:12345-192.168.203.37@tcp:35:bash.0 Request processed in 353us (661us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1789265297.669689:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 29 00010000:00010000:2.0:1789265297.714294:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265297.738330:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265297.738621:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397510144 00000100:00100000:0.0:1789265297.738640:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397510144 00000100:00100000:0.0:1789265297.738743:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 107 00000100:00100000:0.0:1789265297.738758:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bcc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+53:10517:x1876180397510144:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:0.0:1789265297.738793:0:7934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265297.738824:0:7934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262200/0x27274ba5bb95265f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99eff33 expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.738934:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262600/0x27274ba5bb952666 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.738951:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262600/0x27274ba5bb952666 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.738965:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262600/0x27274ba5bb952666 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265297.739011:0:7934:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1789265297.739016:0:7934:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789265297.739039:0:7934:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262600/0x27274ba5bb952666 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.739070:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262200/0x27274ba5bb95265f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff33 expref: 55 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.739184:0:7934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262600/0x27274ba5bb952666 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff33 expref: 54 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.739194:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a101b706300) 00010000:00010000:0.0:1789265297.739197:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789265297.739201:0:7934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1017262600, rc 0) 00000100:00100000:0.0:1789265297.739281:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bcc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+54:10517:x1876180397510144:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 527us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265297.739289:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 107 00000100:00100000:2.0:1789265297.746242:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265297.746542:0:11857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397510272 00000100:00100000:0.0:1789265297.746557:0:11857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397510272 00000100:00100000:0.0:1789265297.746637:0:11857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 108 00000100:00100000:0.0:1789265297.746649:0:11857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bee0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+54:10517:x1876180397510272:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:0.0:1789265297.746675:0:11857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265297.746703:0:11857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262a00/0x27274ba5bb95266d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99eff3a expref: -99 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.746792:0:11857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263a00/0x27274ba5bb952674 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.746811:0:11857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263a00/0x27274ba5bb952674 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.746825:0:11857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263a00/0x27274ba5bb952674 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.746843:0:11857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262800/0x27274ba5bb95267b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.746872:0:11857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262800/0x27274ba5bb95267b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.746880:0:11857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262800/0x27274ba5bb95267b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.747025:0:11857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34a00/0x27274ba5bb952682 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.747036:0:11857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34a00/0x27274ba5bb952682 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.747043:0:11857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34a00/0x27274ba5bb952682 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265297.747115:0:11857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789265297.747120:0:11857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789265297.747152:0:11857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34a00/0x27274ba5bb952682 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.747165:0:11857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34a00/0x27274ba5bb952682 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.747174:0:11857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263a00/0x27274ba5bb952674 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.747180:0:11857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263a00/0x27274ba5bb952674 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.747186:0:11857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263a00/0x27274ba5bb952674 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.747201:0:11857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1017263a00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789265297.747206:0:11857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263a00/0x27274ba5bb952674 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.747214:0:11857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263a00/0x27274ba5bb952674 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.747228:0:11857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a101b706300) 00010000:00010000:0.0:1789265297.747231:0:11857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265297.747235:0:11857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263a00/0x27274ba5bb952674 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.747241:0:11857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263a00/0x27274ba5bb952674 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.747257:0:11857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262800/0x27274ba5bb95267b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.747261:0:11857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262800/0x27274ba5bb95267b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.747266:0:11857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262800/0x27274ba5bb95267b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.747270:0:11857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1017262800 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789265297.747273:0:11857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262800/0x27274ba5bb95267b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.747278:0:11857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262800/0x27274ba5bb95267b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.747295:0:11857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8a101b706c00) 00010000:00010000:0.0:1789265297.747297:0:11857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265297.747300:0:11857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262800/0x27274ba5bb95267b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.747305:0:11857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262800/0x27274ba5bb95267b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.747341:0:11857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262a00/0x27274ba5bb95266d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff3a expref: 56 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.747354:0:11857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34a00/0x27274ba5bb952682 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff3a expref: 55 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.747360:0:11857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a1012931800) 00010000:00010000:0.0:1789265297.747362:0:11857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789265297.747365:0:11857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fa34a00, rc 0) 00000100:00100000:0.0:1789265297.747439:0:11857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bee0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+55:10517:x1876180397510272:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 792us (1211us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265297.747446:0:11857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 108 00000100:00100000:3.0:1789265297.752228:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265297.752483:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397510400 00000100:00100000:1.0:1789265297.752496:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397510400 00000100:00100000:1.0:1789265297.752604:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 7 00000100:00100000:1.0:1789265297.752618:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103fb32680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+55:2349:x1876180397510400:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265297.752642:0:8490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265297.752676:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34a00/0x27274ba5bb952682 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff3a expref: 55 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265297.752699:0:8490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a1012931800) 00010000:00010000:1.0:1789265297.752705:0:8490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265297.752785:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103fb32680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+54:2349:x1876180397510400:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 169us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265297.752793:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 7 00000100:00100000:2.0:1789265297.753236:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265297.753396:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397510656 00000100:00100000:3.0:1789265297.753404:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397510656 00000100:00100000:3.0:1789265297.753453:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 109 00000100:00100000:3.0:1789265297.753462:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bee1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+54:10517:x1876180397510656:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:3.0:1789265297.753486:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265297.753508:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb952689 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99eff41 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265297.753639:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb952690 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265297.753657:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263400/0x27274ba5bb952658 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff2c expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265297.753689:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb952690 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265297.753732:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263400/0x27274ba5bb952658 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff2c expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265297.753750:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263400/0x27274ba5bb952658 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff2c expref: 55 pid: 5842 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265297.753766:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103fb30700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876180414300288:192.168.203.37@tcp:104: 00000100:00100000:3.0:1789265297.753872:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10086f2000 going to sleep for 11 seconds 00000100:00100000:2.0:1789265297.758398:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265297.758489:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397510784 00000100:00100000:1.0:1789265297.758501:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397510784 00010000:00010000:1.0:1789265297.758556:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263400/0x27274ba5bb952658 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff2c expref: 56 pid: 5842 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265297.758606:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 54 00000100:00100000:1.0:1789265297.758619:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10118e5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+56:2350:x1876180397510784:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265297.758637:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265297.758646:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263400/0x27274ba5bb952658 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff2c expref: 56 pid: 5842 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265297.758689:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263400/0x27274ba5bb952658 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff2c expref: 56 pid: 5842 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265297.758696:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103fb30700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876180414300288:192.168.203.37@tcp:104: 00010000:00010000:1.0:1789265297.758718:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263400/0x27274ba5bb952658 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff2c expref: 56 pid: 5842 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265297.758725:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb952690 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265297.758734:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a1012931800) 00010000:00010000:1.0:1789265297.758805:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb952690 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265297.758818:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb952690 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265297.758826:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb952690 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265297.760588:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265297.760718:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10118e5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+55:2350:x1876180397510784:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 2092us (2324us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265297.760734:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 54 00010000:00010000:3.0:1789265297.761504:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb952690 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265297.761520:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb952690 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265297.761553:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789265297.764017:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb952689 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff41 expref: 56 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265297.764056:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb952690 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff41 expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265297.764917:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a1012931800) 00010000:00010000:3.0:1789265297.764921:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789265297.764926:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fae8c00, rc 0) 00000100:00100000:3.0:1789265297.765033:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bee1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+55:10517:x1876180397510656:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 11567us (11794us total) trans 4294967397 rc 0/0 00000100:00100000:3.0:1789265297.765045:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 109 00000100:00100000:2.0:1789265297.775512:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265297.775667:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397511040 00000100:00100000:1.0:1789265297.775680:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397511040 00000100:00100000:1.0:1789265297.775769:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 8 00000100:00100000:1.0:1789265297.775783:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bee1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+55:10517:x1876180397511040:12345-192.168.203.37@tcp:103:lfs.0 00010000:00010000:1.0:1789265297.775805:0:8490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265297.775844:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb9525ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff17 expref: 55 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265297.775894:0:8490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a1012931800) 00010000:00010000:1.0:1789265297.775900:0:8490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265297.775976:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bee1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+54:10517:x1876180397511040:12345-192.168.203.37@tcp:103:lfs.0 Request processed in 196us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265297.775985:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 8 00000100:00100000:2.0:1789265297.778429:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265297.778699:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397511168 00000100:00100000:3.0:1789265297.778711:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397511168 00000100:00100000:3.0:1789265297.778784:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 110 00000100:00100000:3.0:1789265297.778795:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bee0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+54:10517:x1876180397511168:12345-192.168.203.37@tcp:58:lfs.0 00010000:00010000:0.0:1789265297.778960:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb95269e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.778997:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb95269e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.779016:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb95269e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789265297.779914:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1789265297.780644:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bee0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+54:10517:x1876180397511168:12345-192.168.203.37@tcp:58:lfs.0 Request processed in 1842us (2218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265297.780658:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 110 00000100:00100000:2.0:1789265297.787625:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265297.788486:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397511296 00000100:00100000:0.0:1789265297.788889:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397511296 00000100:00100000:0.0:1789265297.788989:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 111 00000100:00100000:0.0:1789265297.789003:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bee0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+54:10517:x1876180397511296:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:0.0:1789265297.789030:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265297.789058:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35600/0x27274ba5bb9526a5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99eff48 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.789205:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb95269e lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.789219:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35600/0x27274ba5bb9526a5 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff48 expref: 55 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.789243:0:5840:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb95269e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.789258:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35600/0x27274ba5bb9526a5 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff48 expref: 55 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.789276:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a1012931800) 00010000:00010000:0.0:1789265297.789280:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789265297.789284:0:5840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35600/0x27274ba5bb9526a5 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff48 expref: 55 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265297.789311:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fa35600, rc 0) 00000100:00100000:0.0:1789265297.789410:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bee0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+55:10517:x1876180397511296:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 410us (1799us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265297.789417:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 111 00000040:00080000:3.0:1789265298.226789:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789265298.226805:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789265298.226875:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1789265298.226884:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789265298.227200:0:11671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103fb30700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11671:1876180414300416:192.168.203.37@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789265298.227373:0:11671:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103bb47240 going to sleep for 11 seconds 00000100:00100000:2.0:1789265298.243275:0:11671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103fb30700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11671:1876180414300416:192.168.203.37@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789265298.246687:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265298.246734:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397511424 00000100:00100000:0.0:1789265298.246747:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397511424 00000100:00080000:0.0:1789265298.246783:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265298.246846:0:11857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 112 00000100:00100000:0.0:1789265298.246857:0:11857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1034af9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+55:10518:x1876180397511424:12345-192.168.203.37@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789265298.246904:0:11857:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789265298.247062:0:11857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1034af9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+55:10518:x1876180397511424:12345-192.168.203.37@tcp:53:lhsmtool_posix.0 Request processed in 205us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265298.247071:0:11857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 112 00000100:00100000:2.0:1789265298.254846:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265298.254964:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397511552 00000100:00100000:0.0:1789265298.254978:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397511552 00000100:00100000:0.0:1789265298.255065:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 113 00000100:00100000:0.0:1789265298.255108:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bee1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+55:10518:x1876180397511552:12345-192.168.203.37@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789265298.255214:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34000/0x27274ba5bb9526ac lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.255242:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34000/0x27274ba5bb9526ac lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.255260:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34000/0x27274ba5bb9526ac lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.255299:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35a00/0x27274ba5bb9526b3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.255308:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35a00/0x27274ba5bb9526b3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.255315:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35a00/0x27274ba5bb9526b3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.255344:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34800/0x27274ba5bb9526ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.255352:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34800/0x27274ba5bb9526ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.255359:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34800/0x27274ba5bb9526ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265298.255426:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789265298.255431:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789265298.255447:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34800/0x27274ba5bb9526ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.255459:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34000/0x27274ba5bb9526ac lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.255465:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34000/0x27274ba5bb9526ac lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.255472:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34000/0x27274ba5bb9526ac lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.255489:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fa34000 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789265298.255494:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34000/0x27274ba5bb9526ac lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.255503:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34000/0x27274ba5bb9526ac lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.255519:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a1032d00f00) 00010000:00010000:0.0:1789265298.255522:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265298.255528:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34000/0x27274ba5bb9526ac lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.255534:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34000/0x27274ba5bb9526ac lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.255550:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35a00/0x27274ba5bb9526b3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.255556:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35a00/0x27274ba5bb9526b3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.255562:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35a00/0x27274ba5bb9526b3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.255579:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fa35a00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789265298.255582:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35a00/0x27274ba5bb9526b3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.255589:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35a00/0x27274ba5bb9526b3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.255608:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff8a101b706c00) 00010000:00010000:0.0:1789265298.255610:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265298.255614:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35a00/0x27274ba5bb9526b3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.255619:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35a00/0x27274ba5bb9526b3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.255636:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34800/0x27274ba5bb9526ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.255642:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34800/0x27274ba5bb9526ba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.255648:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34800/0x27274ba5bb9526ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.255653:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fa34800 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789265298.255864:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34800/0x27274ba5bb9526ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.255871:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34800/0x27274ba5bb9526ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.255884:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a1012931800) 00010000:00010000:0.0:1789265298.255887:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265298.255890:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34800/0x27274ba5bb9526ba lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.255896:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34800/0x27274ba5bb9526ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265298.256013:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bee1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+55:10518:x1876180397511552:12345-192.168.203.37@tcp:34:lhsmtool_posix.0 Request processed in 911us (1179us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265298.256022:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 113 00000100:00100000:3.0:1789265298.259541:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265298.259867:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397511808 00000100:00100000:2.0:1789265298.259882:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397511808 00000100:00100000:2.0:1789265298.259967:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 114 00000100:00100000:2.0:1789265298.259981:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103fb30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+55:10518:x1876180397511808:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789265298.260007:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265298.260034:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb9526c1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99eff4f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.260242:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb9526c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.260270:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb9526c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.260284:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb9526c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265298.260299:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789265298.260429:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb9526c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.260439:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb9526c8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.260447:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb9526c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.260454:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad7400 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789265298.260459:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb9526c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.260467:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb9526c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.260482:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a1012931800) 00010000:00010000:2.0:1789265298.260485:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789265298.260490:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb9526c8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.260497:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb9526c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.260548:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb9526c1 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff4f expref: 57 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.260566:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a1032d00f00) 00010000:00010000:2.0:1789265298.260569:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789265298.260573:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb9526c1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff4f expref: 57 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.260584:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fad7a00, rc 0) 00000100:00100000:2.0:1789265298.260662:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103fb30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+56:10518:x1876180397511808:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 686us (1134us total) trans 4294967398 rc 301/301 00000100:00100000:2.0:1789265298.260670:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 114 00000100:00100000:2.0:1789265298.268620:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265298.268725:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397511936 00000100:00100000:3.0:1789265298.268737:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397511936 00000100:00100000:3.0:1789265298.268817:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 115 00000100:00100000:3.0:1789265298.268831:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1009073480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+56:10518:x1876180397511936:12345-192.168.203.37@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789265298.268879:0:5842:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789265298.269040:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1009073480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+56:10518:x1876180397511936:12345-192.168.203.37@tcp:53:lhsmtool_posix.0 Request processed in 211us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265298.269067:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 115 00000100:00100000:2.0:1789265298.279485:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265298.279838:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397512192 00000100:00100000:3.0:1789265298.279853:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397512192 00000100:00100000:3.0:1789265298.279928:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 116 00000100:00100000:3.0:1789265298.279939:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1009070700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+56:10518:x1876180397512192:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789265298.279968:0:7934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265298.279972:0:7934:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789265298.280009:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262600/0x27274ba5bb952666 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff33 expref: 56 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.280032:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a101b706300) 00010000:00010000:3.0:1789265298.280039:0:7934:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789265298.280056:0:7934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb9526d6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99eff56 expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789265298.280995:0:7934:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:3.0:1789265298.281398:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9c00/0x27274ba5bb9526dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.281419:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9c00/0x27274ba5bb9526dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.281434:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9c00/0x27274ba5bb9526dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.281512:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb9526d6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff56 expref: 58 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.281558:0:7934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9c00/0x27274ba5bb9526dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff56 expref: 57 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.281844:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8a1032d00b00) 00010000:00010000:3.0:1789265298.281848:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789265298.281852:0:7934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fae9c00, rc 0) 00000100:00100000:3.0:1789265298.281955:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1009070700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+57:10518:x1876180397512192:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 2015us (2484us total) trans 4294967399 rc 0/0 00000100:00100000:3.0:1789265298.281966:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 116 00000100:00100000:1.0:1789265298.287818:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265298.287990:0:11857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397512448 00000100:00100000:0.0:1789265298.288003:0:11857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397512448 00000100:00100000:0.0:1789265298.288104:0:11857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 117 00000100:00100000:0.0:1789265298.288117:0:11857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bcc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+57:10518:x1876180397512448:12345-192.168.203.37@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789265298.288204:0:11857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265298.288241:0:11857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9c00/0x27274ba5bb9526dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff56 expref: 57 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.288265:0:11857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8a1032d00b00) 00010000:00010000:0.0:1789265298.288279:0:11857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789265298.288306:0:11857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34800/0x27274ba5bb9526eb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.288322:0:11857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34800/0x27274ba5bb9526eb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.288333:0:11857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34800/0x27274ba5bb9526eb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.288350:0:11857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35a00/0x27274ba5bb9526f2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x9885bbb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.288357:0:11857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35a00/0x27274ba5bb9526f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9885bbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.288363:0:11857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35a00/0x27274ba5bb9526f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9885bbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.288463:0:11857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34800/0x27274ba5bb9526eb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.288472:0:11857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34800/0x27274ba5bb9526eb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.288479:0:11857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34800/0x27274ba5bb9526eb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.288486:0:11857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fa34800 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789265298.288491:0:11857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34800/0x27274ba5bb9526eb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.288500:0:11857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34800/0x27274ba5bb9526eb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.288509:0:11857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a101b706300) 00010000:00010000:0.0:1789265298.288512:0:11857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265298.288517:0:11857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34800/0x27274ba5bb9526eb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.288523:0:11857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34800/0x27274ba5bb9526eb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.288532:0:11857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35a00/0x27274ba5bb9526f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9885bbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.288538:0:11857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35a00/0x27274ba5bb9526f2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9885bbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.288543:0:11857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35a00/0x27274ba5bb9526f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9885bbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.288555:0:11857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fa35a00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789265298.288558:0:11857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35a00/0x27274ba5bb9526f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9885bbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.288565:0:11857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35a00/0x27274ba5bb9526f2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9885bbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.288573:0:11857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x9885bbb (ffff8a101b706c00) 00010000:00010000:0.0:1789265298.288575:0:11857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265298.288578:0:11857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35a00/0x27274ba5bb9526f2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x9885bbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.288583:0:11857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35a00/0x27274ba5bb9526f2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x9885bbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265298.289016:0:11857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bcc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+56:10518:x1876180397512448:12345-192.168.203.37@tcp:36:lhsmtool_posix.0 Request processed in 898us (1208us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789265298.289029:0:11857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 117 00000100:00100000:2.0:1789265298.300873:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265298.300980:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397512576 00000100:00100000:3.0:1789265298.300994:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397512576 00000100:00100000:3.0:1789265298.301071:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 118 00000100:00100000:3.0:1789265298.301103:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1009072300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+56:10518:x1876180397512576:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789265298.301142:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265298.301172:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb9526f9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99eff5d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.301221:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb952700 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.301239:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb952700 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.301252:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb952700 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.301388:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb9526f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff5d expref: 58 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.301419:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb952700 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff5d expref: 57 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.301429:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8a1032d00200) 00010000:00010000:3.0:1789265298.301432:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789265298.301436:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fae8800, rc 0) 00000100:00100000:3.0:1789265298.301510:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1009072300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+57:10518:x1876180397512576:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 411us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265298.301518:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 118 00000100:00100000:2.0:1789265298.310231:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265298.310352:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397512832 00000100:00100000:3.0:1789265298.310366:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397512832 00000100:00100000:3.0:1789265298.310437:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 119 00000100:00100000:3.0:1789265298.310450:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1009073100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+57:10518:x1876180397512832:12345-192.168.203.37@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789265298.310558:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb952707 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.310592:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb952707 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.310608:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb952707 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789265298.310958:0:7934:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:3.0:1789265298.310971:0:7934:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 344115895660ns, next at 345115891558ns, rc = 0 00000004:00010000:3.0:1789265298.311116:0:7934:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004e0f4a5d reply state 000000000f8c082e transno 4294967400 ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb952707 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265298.311162:0:7934:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789265298.311289:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1009073100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+59:10518:x1876180397512832:12345-192.168.203.37@tcp:36:lhsmtool_posix.0 Request processed in 839us (1070us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1789265298.311298:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 119 00000100:00100000:2.0:1789265298.315549:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265298.315748:0:11857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397512960 00000100:00100000:2.0:1789265298.315762:0:11857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397512960 00000100:00100000:2.0:1789265298.315840:0:11857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 120 00000100:00100000:2.0:1789265298.315852:0:11857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1009072d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+59:10518:x1876180397512960:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789265298.315886:0:11857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265298.315914:0:11857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6400/0x27274ba5bb95270e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99eff64 expref: -99 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.315995:0:11857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6400/0x27274ba5bb95270e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff64 expref: 60 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.316013:0:11857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6400/0x27274ba5bb95270e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff64 expref: 60 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.316059:0:11857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8a1032d00200) 00010000:00010000:2.0:1789265298.316062:0:11857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789265298.316067:0:11857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fad6400, rc 0) 00000100:00100000:2.0:1789265298.316186:0:11857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1009072d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+60:10518:x1876180397512960:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 336us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265298.316193:0:11857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 120 00010000:00010000:3.0:1789265298.318358:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb952707 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.318382:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb952707 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.318389:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb952707 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.318396:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fae8e00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789265298.318401:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb952707 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.318410:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb952707 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.318431:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8a1032d00200) 00010000:00010000:3.0:1789265298.318434:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789265298.318438:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb952707 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.318444:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb952707 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265298.325416:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265298.326689:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397513088 00000100:00100000:0.0:1789265298.326708:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397513088 00000100:00100000:0.0:1789265298.326811:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 37 00000100:00100000:0.0:1789265298.326824:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103fb30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+8:2348:x1876180397513088:12345-192.168.203.37@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789265298.327275:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103fb30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+9:2348:x1876180397513088:12345-192.168.203.37@tcp:2:lhsmtool_posix.0 Request processed in 451us (1872us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1789265298.327284:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 37 00000100:00080000:3.0:1789265298.327613:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1789265298.336971:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:0.0:1789265298.337226:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000001:00080000:1.0:1789265298.337257:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:3.0:1789265298.337325:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397513344 00000100:00100000:3.0:1789265298.337339:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397513344 00000100:00100000:3.0:1789265298.337411:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 30 00000100:00100000:3.0:1789265298.337424:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1034af8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+59:10518:x1876180397513344:12345-192.168.203.37@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789265298.338226:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1034af8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+60:10518:x1876180397513344:12345-192.168.203.37@tcp:35:lhsmtool_posix.0 Request processed in 800us (1002us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1789265298.338237:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 30 00000100:00100000:0.0:1789265298.341164:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265298.341283:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397513600 00000100:00100000:2.0:1789265298.341297:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397513600 00000100:00100000:2.0:1789265298.341375:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 121 00000100:00100000:2.0:1789265298.341388:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1034afb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+60:10518:x1876180397513600:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789265298.341536:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1034afb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+60:10518:x1876180397513600:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 Request processed in 150us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265298.341545:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 121 00000100:00100000:3.0:1789265298.345605:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265298.346762:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397513728 00000100:00100000:2.0:1789265298.346779:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397513728 00000100:00100000:2.0:1789265298.346902:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 122 00000100:00100000:2.0:1789265298.346915:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103fb31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+60:10518:x1876180397513728:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789265298.346943:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265298.346971:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952715 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99eff6b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.347092:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb95271c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.347111:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb95271c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.347153:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb95271c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265298.347203:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789265298.347229:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb95271c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.347261:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952715 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff6b expref: 62 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.347284:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb95271c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff6b expref: 61 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.347293:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8a1032d00200) 00010000:00010000:2.0:1789265298.347296:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789265298.347300:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fad6a00, rc 0) 00000100:00100000:2.0:1789265298.347392:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103fb31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+61:10518:x1876180397513728:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 479us (1801us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265298.347400:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 122 00000100:00100000:1.0:1789265298.350642:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265298.350801:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397513856 00000100:00100000:3.0:1789265298.350815:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397513856 00000100:00100000:3.0:1789265298.350887:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 38 00000100:00100000:3.0:1789265298.350898:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bcc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+9:2350:x1876180397513856:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789265298.350922:0:8856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265298.350950:0:8856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c55b5878/0x27274ba5bb952723 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99eff72 expref: -99 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789265298.350982:0:8856:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa60592, blocks: 0x1 00010000:00010000:3.0:1789265298.351016:0:8856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=344s v=(0 0) 00010000:00010000:3.0:1789265298.351022:0:8856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265298.351034:0:8856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c55b5878/0x27274ba5bb952723 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff72 expref: 10 pid: 8856 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.351057:0:8856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c55b5878/0x27274ba5bb952723 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff72 expref: 10 pid: 8856 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.351107:0:8856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fae8e00, rc 0) 00000100:00100000:3.0:1789265298.351199:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bcc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+10:2350:x1876180397513856:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 303us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265298.351208:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 38 00000100:00100000:3.0:1789265298.355184:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265298.355318:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397514112 00000100:00100000:2.0:1789265298.355332:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397514112 00000100:00100000:2.0:1789265298.355413:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 123 00000100:00100000:2.0:1789265298.355426:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103fb31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+61:10518:x1876180397514112:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789265298.355563:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103fb31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+61:10518:x1876180397514112:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 Request processed in 139us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265298.355582:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 123 00000100:00100000:1.0:1789265298.359112:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265298.359294:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397514240 00000100:00100000:0.0:1789265298.359308:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397514240 00000100:00100000:0.0:1789265298.359386:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 39 00000100:00100000:0.0:1789265298.359399:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bcc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+10:10518:x1876180397514240:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789265298.359424:0:6684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265298.359452:0:6684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000cb20beb/0x27274ba5bb95272a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99eff79 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.359494:0:6684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c55b5878/0x27274ba5bb952723 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff72 expref: 11 pid: 8856 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.359504:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265298.359509:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265298.359515:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000cb20beb/0x27274ba5bb95272a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff79 expref: 11 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.359561:0:6684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c55b5878/0x27274ba5bb952723 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff72 expref: 11 pid: 8856 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.359756:0:6684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c55b5878/0x27274ba5bb952723 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff72 expref: 11 pid: 8856 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265298.359774:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1034af9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6684:1876180414300544:192.168.203.37@tcp:104: 00000100:00100000:0.0:1789265298.359935:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10031cb900 going to sleep for 11 seconds 00000100:00100000:0.0:1789265298.362826:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1034af9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6684:1876180414300544:192.168.203.37@tcp:104: 00010000:00010000:0.0:1789265298.362876:0:6684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000cb20beb/0x27274ba5bb95272a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff79 expref: 11 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.362926:0:6684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fa34000, rc 0) 00000100:00100000:0.0:1789265298.363012:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bcc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+11:10518:x1876180397514240:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 3606us (3939us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265298.363023:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 39 00000100:00100000:0.0:1789265298.366600:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265298.366763:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397514368 00000100:00100000:3.0:1789265298.366776:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397514368 00010000:00010000:3.0:1789265298.366833:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c55b5878/0x27274ba5bb952723 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff72 expref: 11 pid: 8856 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265298.366953:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 55 00000100:00100000:3.0:1789265298.366965:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1034af9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+11:2350:x1876180397514368:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265298.366997:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265298.367035:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c55b5878/0x27274ba5bb952723 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff72 expref: 11 pid: 8856 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.367055:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c55b5878/0x27274ba5bb952723 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff72 expref: 11 pid: 8856 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.367121:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c55b5878/0x27274ba5bb952723 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff72 expref: 11 pid: 8856 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.367150:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265298.367158:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265298.367168:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000cb20beb/0x27274ba5bb95272a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff79 expref: 10 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.367205:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000cb20beb/0x27274ba5bb95272a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff79 expref: 10 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.367262:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000cb20beb/0x27274ba5bb95272a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff79 expref: 10 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265298.367280:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103fb32680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5825:1876180414300672:192.168.203.37@tcp:105: 00000100:00100000:3.0:1789265298.367390:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1002cd7780 going to sleep for 11 seconds 00000100:00100000:3.0:1789265298.371881:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265298.373176:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397514496 00000100:00100000:1.0:1789265298.373199:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397514496 00002000:00100000:1.0:1789265298.373274:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8a103fb31180 x1876180397514496/t0(0) o4->4b820fcb-1bab-4b78-bfa4-355c22a09cf8@192.168.203.37@tcp:624/0 lens 504/0 e 0 to 0 dl 1789265309 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789265298.373289:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a103fb31180 with x1876180397514496 ext(0->12) 00002000:00010000:1.0:1789265298.373297:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a103fb31180 00000100:00100000:1.0:1789265298.373339:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 2 00000100:00100000:1.0:1789265298.373351:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103fb31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+11:2350:x1876180397514496:12345-192.168.203.37@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789265298.374815:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103fb32680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5825:1876180414300672:192.168.203.37@tcp:105: 00010000:00010000:0.0:1789265298.374860:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265298.375609:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103fb31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+13:2350:x1876180397514496:12345-192.168.203.37@tcp:4:lhsmtool_posix.0 Request processed in 2255us (3738us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1789265298.375622:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 2 00002000:00100000:1.0:1789265298.375636:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8a103fb31180 x1876180397514496/t4294967308(0) o4->4b820fcb-1bab-4b78-bfa4-355c22a09cf8@192.168.203.37@tcp:624/0 lens 504/448 e 0 to 0 dl 1789265309 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789265298.375657:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a103fb31180 with x1876180397514496 ext(0->12) 00002000:00010000:1.0:1789265298.375676:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a103fb31180 00000100:00100000:2.0:1789265298.375855:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1034af9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+12:2350:x1876180397514368:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 8890us (9265us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265298.375875:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 55 00000100:00100000:0.0:1789265298.378480:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265298.378589:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397514624 00000100:00100000:3.0:1789265298.378602:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397514624 00000100:00100000:3.0:1789265298.378687:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 124 00000100:00100000:3.0:1789265298.378701:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1034af9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+61:10518:x1876180397514624:12345-192.168.203.37@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789265298.446590:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967393 is committed 00000004:00080000:2.0:1789265298.446616:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000001:00080000:2.0:1789265298.446725:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967396 is committed 00000020:00080000:2.0:1789265298.446770:0:5863:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8a1007e7ab40 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1789265298.446777:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a1008916e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8a1007e7a840 00000020:00080000:2.0:1789265298.446781:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a1008916100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8a1016d72400 00000100:00100000:0.0:1789265298.446799:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1034af9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+43:10518:x1876180397514624:12345-192.168.203.37@tcp:44:lhsmtool_posix.0 Request processed in 68091us (68325us total) trans 0 rc 0/0 00000001:00080000:2.0:1789265298.446803:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967398 is committed 00000100:00100000:0.0:1789265298.446819:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 124 00000001:00080000:2.0:1789265298.446863:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967401 is committed 00000004:00080000:2.0:1789265298.446873:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000100:00100000:0.0:1789265298.448474:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103fb32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414300800:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789265298.448548:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265298.448630:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789265298.448638:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1008e25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414300928:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789265298.448659:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265298.448695:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414300800 00000100:00100000:0.0:1789265298.448702:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414300800 00000100:00100000:0.0:1789265298.448756:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414300928 00000100:00100000:0.0:1789265298.448760:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414300928 00000100:00100000:0.0:1789265298.448781:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789265298.448789:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1034afbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3315:x1876180414300800:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789265298.448818:0:6682:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:0.0:1789265298.448846:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038df497b/0x27274ba5bb952731 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789265298.448861:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789265298.448890:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e75e70fa/0x27274ba5bb9524f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efed8 expref: 11 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265298.448899:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00010000:00010000:0.0:1789265298.448911:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1789265298.448917:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789265298.448927:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038df497b/0x27274ba5bb952731 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.448963:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e75e70fa/0x27274ba5bb9524f3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efed8 expref: 11 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.448979:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e75e70fa/0x27274ba5bb9524f3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efed8 expref: 11 pid: 6684 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265298.448992:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1034afb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3315:x1876180414300928:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789265298.448993:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1034afa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6682:1876180414301056:192.168.203.37@tcp:104: 00000100:00100000:0.0:1789265298.449051:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10031cb000 going to sleep for 11 seconds 00002000:00010000:3.0:1789265298.449604:0:8856:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789265298.449610:0:8856:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789265298 00002000:00010000:3.0:1789265298.449613:0:8856:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789265298.449615:0:8856:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1789265298 -> 1789265298 00002000:00010000:3.0:1789265298.449617:0:8856:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000004:00080000:2.0:1789265298.451434:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000100:00100000:3.0:1789265298.451955:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265298.452036:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1789265298.452047:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:3.0:1789265298.452261:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1034afa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6682:1876180414301056:192.168.203.37@tcp:104: 00010000:00010000:3.0:1789265298.452294:0:6682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000038df497b/0x27274ba5bb952731 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265298.452341:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397514752 00000100:00100000:3.0:1789265298.452348:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397514752 00000100:00100000:3.0:1789265298.452473:0:12007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 42 00000100:00100000:3.0:1789265298.452485:0:12007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008e24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+12:2351:x1876180397514752:12345-192.168.203.37@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1789265298.456518:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1034afb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3315:x1876180414300928:12345-0@lo:2:osp-syn-1-0.0 Request processed in 7590us (7842us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1789265298.456536:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:1.0:1789265298.457534:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a1008e25500/2, rc 0, transno 4294967309 00000100:00100000:1.0:1789265298.457547:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1008e25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414300928:0@lo:2:osp-syn-1-0.0 00000020:00080000:2.0:1789265298.459284:0:5863:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8a103bb47900 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1789265298.459303:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a1012a48200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8a103bb47c00 00000020:00080000:2.0:1789265298.459307:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a1012a48b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8a103bb53000 00000020:00080000:2.0:1789265298.459364:0:5874:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000100:00100000:1.0:1789265298.460874:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103bcc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414301184:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789265298.462519:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265298.462626:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414301184 00000100:00100000:1.0:1789265298.462637:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414301184 00000020:00080000:2.0:1789265298.462755:0:5874:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1789265298.463253:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265298.463884:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789265298.463903:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bcc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1876180414301184:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789265298.464768:0:6684:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:1.0:1789265298.464818:0:6684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa60591, atime: 0x6aa60591, ctime: 0x6aa60591, blocks: 0xb 00010000:00010000:1.0:1789265298.464828:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1451423/0x27274ba5bb952738 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265298.464850:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=344s v=(0 0) 00010000:00010000:1.0:1789265298.464855:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265298.464862:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1451423/0x27274ba5bb952738 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265298.464881:0:6684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f1451423/0x27274ba5bb952738 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265298.464892:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1451423/0x27274ba5bb952738 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265298.464919:0:6684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f1451423/0x27274ba5bb952738 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265298.465063:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397514880 00000100:00100000:2.0:1789265298.465103:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397514880 00010000:00010000:2.0:1789265298.465163:0:8490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e75e70fa/0x27274ba5bb9524f3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efed8 expref: 13 pid: 6684 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265298.465199:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 56 00000100:00100000:2.0:1789265298.465208:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1034afad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+13:2350:x1876180397514880:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265298.465221:0:8490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265298.465227:0:8490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e75e70fa/0x27274ba5bb9524f3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efed8 expref: 13 pid: 6684 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.465254:0:8490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e75e70fa/0x27274ba5bb9524f3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efed8 expref: 13 pid: 6684 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.465282:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e75e70fa/0x27274ba5bb9524f3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efed8 expref: 13 pid: 6684 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.465301:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789265298.465305:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789265298.465310:0:8490:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000038df497b/0x27274ba5bb952731 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.465319:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038df497b/0x27274ba5bb952731 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.465348:0:8490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265298.465425:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1034afad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+12:2350:x1876180397514880:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 218us (2182us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265298.465433:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 56 00010000:00010000:2.0:1789265298.465470:0:6682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000038df497b/0x27274ba5bb952731 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.465480:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000038df497b/0x27274ba5bb952731 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.465489:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038df497b/0x27274ba5bb952731 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.465504:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000038df497b/0x27274ba5bb952731 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.465523:0:6682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789265298.466294:0:6684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789265298.467150:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789265298.467164:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000038df497b/0x27274ba5bb952731 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.467178:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fa35200 already unused, calling callback (ffffffffc1581350) 00010000:00010000:0.0:1789265298.467183:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000038df497b/0x27274ba5bb952731 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.467213:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000038df497b/0x27274ba5bb952731 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.467240:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000038df497b/0x27274ba5bb952731 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.467249:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000038df497b/0x27274ba5bb952731 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.467275:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265298.467280:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f1451423/0x27274ba5bb952738 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.467288:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b596200 already unused, calling callback (ffffffffc1581350) 00010000:00010000:0.0:1789265298.467291:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1451423/0x27274ba5bb952738 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.467299:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1451423/0x27274ba5bb952738 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.467310:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f1451423/0x27274ba5bb952738 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.467317:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1451423/0x27274ba5bb952738 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.467344:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265298.467347:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265298.467349:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265298.467357:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265298.471809:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1034afbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3315:x1876180414300800:12345-0@lo:6:osp-syn-1-0.0 Request processed in 23007us (23246us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1789265298.471827:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789265298.472103:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bcc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3317:x1876180414301184:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8177us (9562us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1789265298.472112:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789265298.472883:0:3317:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:0.0:1789265298.472893:0:3317:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967303 00000004:00080000:0.0:1789265298.472919:0:3317:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a10037b1500, transno 4294967301 00000004:00080000:0.0:1789265298.473071:0:3317:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967303 00000100:00100000:0.0:1789265298.473227:0:3317:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8a103bcc4380 x1876180414301184/t4294967304(4294967304) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789265314 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1789265298.473242:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a103bcc4380/2, rc 0, transno 4294967304 00000100:00100000:0.0:1789265298.473248:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103bcc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414301184:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1789265298.473633:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a103fb32680/2, rc 0, transno 4294967310 00000100:00100000:2.0:1789265298.473643:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103fb32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414300800:0@lo:6:osp-syn-1-0.0 00000001:00080000:2.0:1789265298.522674:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:2.0:1789265298.522713:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:2.0:1789265298.522727:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:2.0:1789265298.522735:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:2.0:1789265298.522899:0:12007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008e24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:2351:x1876180397514752:12345-192.168.203.37@tcp:16:lhsmtool_posix.0 Request processed in 70406us (70941us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265298.522916:0:12007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 42 00000100:00100000:0.0:1789265298.529545:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265298.529677:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397515136 00000100:00100000:2.0:1789265298.529693:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397515136 00000100:00100000:2.0:1789265298.529851:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 125 00000100:00100000:2.0:1789265298.529863:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1034afb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+15:10518:x1876180397515136:12345-192.168.203.37@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789265298.529942:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265298.529983:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb95271c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff6b expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.530072:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8a1032d00200) 00010000:00010000:2.0:1789265298.530331:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789265298.530978:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb95273f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.531066:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb95273f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.531326:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb95273f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789265298.532976:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c77dcda0 reply state 00000000657be915 transno 4294967402 ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb95273f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265298.534219:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789265298.535802:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1034afb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+16:10518:x1876180397515136:12345-192.168.203.37@tcp:36:lhsmtool_posix.0 Request processed in 5923us (6256us total) trans 4294967402 rc 0/0 00000100:00100000:2.0:1789265298.535818:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 125 00010000:00010000:2.0:1789265298.543144:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb95273f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.543170:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb95273f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.543179:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb95273f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.543186:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad6600 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789265298.543192:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb95273f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.543201:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb95273f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.543254:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8a1032d00200) 00010000:00010000:2.0:1789265298.543257:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265298.543264:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb95273f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.543271:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb95273f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265298.545175:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265298.548294:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397515264 00000100:00100000:2.0:1789265298.548316:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397515264 00000100:00100000:0.0:1789265298.548606:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 44 00000100:00100000:0.0:1789265298.548622:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008755f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:2350:x1876180397515264:12345-192.168.203.37@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789265298.548922:0:8856:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1789265298.548926:0:8856:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1789265298 -> 1789265297 00002000:00010000:0.0:1789265298.548929:0:8856:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789265297 00002000:00010000:0.0:1789265298.548932:0:8856:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1789265298 -> 1789265297 00002000:00010000:0.0:1789265298.548934:0:8856:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1789265298.549284:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008755f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+7:2350:x1876180397515264:12345-192.168.203.37@tcp:2:lhsmtool_posix.0 Request processed in 663us (4352us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1789265298.549294:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 44 00000100:00100000:0.0:1789265298.552277:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265298.552410:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397515520 00000100:00100000:3.0:1789265298.552423:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397515520 00000100:00100000:3.0:1789265298.552497:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 126 00000100:00100000:3.0:1789265298.552510:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1034af9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+15:10518:x1876180397515520:12345-192.168.203.37@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789265298.552603:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb952746 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.552623:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb952700 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff5d expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.552634:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb952746 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.552679:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb952700 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff5d expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.552698:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb952700 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff5d expref: 15 pid: 5841 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265298.552734:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1008754700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1876180414301312:192.168.203.37@tcp:104: 00000100:00100000:3.0:1789265298.554354:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1002cd7300 going to sleep for 11 seconds 00000100:00100000:3.0:1789265298.561716:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265298.561961:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397515648 00000100:00100000:1.0:1789265298.561974:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397515648 00010000:00010000:1.0:1789265298.562032:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb952700 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff5d expref: 16 pid: 5841 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265298.562149:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 57 00000100:00100000:1.0:1789265298.562163:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10091e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+16:2350:x1876180397515648:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265298.562185:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265298.562195:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb952700 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff5d expref: 16 pid: 5841 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265298.562216:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb952700 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff5d expref: 16 pid: 5841 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265298.562251:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8a1032d00200) 00010000:00010000:1.0:1789265298.562258:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb952746 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265298.562270:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb952746 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265298.562301:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb952746 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265298.562327:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265298.562403:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10091e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+16:2350:x1876180397515648:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 242us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265298.562412:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 57 00010000:00010000:2.0:1789265298.562813:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb952700 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff5d expref: 15 pid: 5841 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265298.562835:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1008754700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1876180414301312:192.168.203.37@tcp:104: 00010000:00010000:2.0:1789265298.562864:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb952746 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.562876:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb952746 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.562882:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb952746 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.562921:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb952746 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.562940:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb952746 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.562948:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb952746 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.562965:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fae8e00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789265298.562971:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb952746 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.562980:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb952746 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.562992:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8a1032d00200) 00010000:00010000:2.0:1789265298.562995:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789265298.562999:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb952746 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.563005:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb952746 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265298.563123:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1034af9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+14:10518:x1876180397515520:12345-192.168.203.37@tcp:55:lhsmtool_posix.0 Request processed in 10566us (10810us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789265298.563144:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 126 00000100:00100000:3.0:1789265298.566956:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265298.567027:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397515776 00000100:00100000:2.0:1789265298.567041:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397515776 00000100:00100000:2.0:1789265298.567164:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 45 00000100:00100000:2.0:1789265298.567186:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10091e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+7:2349:x1876180397515776:12345-192.168.203.37@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789265298.567260:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e75e70fa/0x27274ba5bb95274d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.567288:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000cb20beb/0x27274ba5bb95272a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff79 expref: 7 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.567321:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265298.567327:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789265298.567332:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e75e70fa/0x27274ba5bb95274d lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.567379:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000cb20beb/0x27274ba5bb95272a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff79 expref: 7 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.567397:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000cb20beb/0x27274ba5bb95272a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff79 expref: 7 pid: 6684 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265298.567415:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1009071500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6682:1876180414301440:192.168.203.37@tcp:104: 00000100:00100000:2.0:1789265298.567514:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a102ec330c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265298.573327:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265298.573708:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1009071500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6682:1876180414301440:192.168.203.37@tcp:104: 00010000:00010000:2.0:1789265298.573747:0:6682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e75e70fa/0x27274ba5bb95274d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265298.573755:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397515904 00000100:00100000:3.0:1789265298.573764:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397515904 00010000:00010000:3.0:1789265298.573819:0:8490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000cb20beb/0x27274ba5bb95272a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff79 expref: 8 pid: 6684 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265298.573869:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 58 00000100:00100000:3.0:1789265298.573880:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bcc5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+8:2351:x1876180397515904:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265298.573900:0:8490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265298.573933:0:8490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000cb20beb/0x27274ba5bb95272a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff79 expref: 8 pid: 6684 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.573952:0:8490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000cb20beb/0x27274ba5bb95272a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff79 expref: 8 pid: 6684 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.573984:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000cb20beb/0x27274ba5bb95272a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff79 expref: 8 pid: 6684 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.574005:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789265298.574010:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789265298.574016:0:8490:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e75e70fa/0x27274ba5bb95274d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.574052:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e75e70fa/0x27274ba5bb95274d lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.574142:0:8490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265298.574213:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bcc5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+7:2351:x1876180397515904:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 334us (901us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265298.574221:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 58 00010000:00010000:1.0:1789265298.574321:0:6682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e75e70fa/0x27274ba5bb95274d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265298.574330:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e75e70fa/0x27274ba5bb95274d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265298.574363:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e75e70fa/0x27274ba5bb95274d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265298.574373:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e75e70fa/0x27274ba5bb95274d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265298.574382:0:6682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e75e70fa/0x27274ba5bb95274d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265298.574390:0:6682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad6600 already unused, calling callback (ffffffffc1581350) 00010000:00010000:1.0:1789265298.574395:0:6682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e75e70fa/0x27274ba5bb95274d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265298.574420:0:6682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e75e70fa/0x27274ba5bb95274d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265298.574443:0:6682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e75e70fa/0x27274ba5bb95274d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265298.574453:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e75e70fa/0x27274ba5bb95274d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265298.574525:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10091e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:2349:x1876180397515776:12345-192.168.203.37@tcp:1:lhsmtool_posix.0 Request processed in 7351us (7583us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265298.574535:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 45 00000100:00100000:1.0:1789265298.578712:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265298.578771:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397516160 00000100:00100000:3.0:1789265298.578785:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397516160 00000100:00100000:3.0:1789265298.578867:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 127 00000100:00100000:3.0:1789265298.578880:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bcc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+14:10518:x1876180397516160:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789265298.578992:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb952754 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.579017:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb952754 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.579032:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb952754 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.579587:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8200/0x27274ba5bb95275b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.579604:0:7934:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6400/0x27274ba5bb95270e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff64 expref: 15 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.579613:0:7934:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8200/0x27274ba5bb95275b lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.579676:0:7934:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6400/0x27274ba5bb95270e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff64 expref: 15 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.579696:0:7934:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6400/0x27274ba5bb95270e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff64 expref: 15 pid: 11857 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265298.579714:0:7934:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10091eaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7934:1876180414301568:192.168.203.37@tcp:104: 00000100:00100000:3.0:1789265298.580571:0:7934:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1002cd7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265298.583698:0:7934:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10091eaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7934:1876180414301568:192.168.203.37@tcp:104: 00010000:00010000:3.0:1789265298.583742:0:7934:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8200/0x27274ba5bb95275b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265298.587629:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265298.587769:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397516288 00000100:00100000:0.0:1789265298.587784:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397516288 00010000:00010000:0.0:1789265298.587847:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6400/0x27274ba5bb95270e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff64 expref: 16 pid: 11857 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265298.587899:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 59 00000100:00100000:0.0:1789265298.587913:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bcc6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+16:2350:x1876180397516288:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265298.587944:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265298.587954:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6400/0x27274ba5bb95270e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff64 expref: 16 pid: 11857 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.587975:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6400/0x27274ba5bb95270e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff64 expref: 16 pid: 11857 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.588004:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6400/0x27274ba5bb95270e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff64 expref: 16 pid: 11857 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.588024:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8a1032d00200) 00010000:00010000:0.0:1789265298.588029:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8200/0x27274ba5bb95275b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.588041:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8200/0x27274ba5bb95275b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.588050:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8200/0x27274ba5bb95275b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.588157:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789265298.588176:0:7934:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8200/0x27274ba5bb95275b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.588187:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8200/0x27274ba5bb95275b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265298.588367:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bcc6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+15:2350:x1876180397516288:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 455us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265298.588401:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 59 00000001:00080000:3.0:1789265298.588548:0:7934:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:3.0:1789265298.588735:0:7934:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:3.0:1789265298.588789:0:7934:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:3.0:1789265298.588896:0:7934:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10091eaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7934:1876180414301696:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789265298.588959:0:7934:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265298.589012:0:7934:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1002cd7180 going to sleep for 11 seconds 00000100:00100000:0.0:1789265298.589213:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414301696 00000100:00100000:0.0:1789265298.589221:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414301696 00000100:00100000:0.0:1789265298.589263:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789265298.589273:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10091e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7934:x1876180414301696:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789265298.589381:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10091e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7934:x1876180414301696:12345-0@lo:1000:mdt00_003.0 Request processed in 109us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265298.589389:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789265298.589676:0:7934:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:3.0:1789265298.589683:0:7934:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:3.0:1789265298.589714:0:7934:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a1008e25500, transno 4294967309 00000100:00100000:3.0:1789265298.589755:0:7934:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8a103fb32680 x1876180414300800/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789265314 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265298.589771:0:7934:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10091eaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7934:1876180414301696:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1789265298.590953:0:7934:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:3.0:1789265298.591055:0:7934:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10091eaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7934:1876180414301824:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789265298.591163:0:7934:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265298.591206:0:7934:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1002cd7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265298.591312:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414301824 00000100:00100000:0.0:1789265298.591321:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414301824 00000100:00100000:1.0:1789265298.591448:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789265298.591464:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103fa66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7934:x1876180414301824:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789265298.591734:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103fa66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:7934:x1876180414301824:12345-0@lo:1000:mdt00_003.0 Request processed in 274us (570us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1789265298.591743:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789265298.591896:0:7934:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10091eaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7934:1876180414301824:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1789265298.591943:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8200/0x27274ba5bb95275b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.591951:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8200/0x27274ba5bb95275b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.591958:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8200/0x27274ba5bb95275b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.591962:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fae8200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789265298.591966:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8200/0x27274ba5bb95275b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.591972:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8200/0x27274ba5bb95275b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.591989:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8a1032d00200) 00010000:00010000:3.0:1789265298.591992:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789265298.592065:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8200/0x27274ba5bb95275b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.592102:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8200/0x27274ba5bb95275b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.592167:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb95269e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.592174:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb95269e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.592181:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb95269e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.592186:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fae9200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789265298.592189:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb95269e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.592195:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb95269e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.592205:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a1012931800) 00010000:00010000:3.0:1789265298.592208:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789265298.592215:0:7934:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35600/0x27274ba5bb9526a5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff48 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.592228:0:7934:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35600/0x27274ba5bb9526a5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff48 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.592238:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35600/0x27274ba5bb9526a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff48 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.592274:0:7934:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35600/0x27274ba5bb9526a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff48 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265298.592302:0:7934:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103fa65c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7934:1876180414301952:192.168.203.37@tcp:105: 00000100:00100000:3.0:1789265298.592382:0:7934:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1002cd7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265298.596482:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265298.596702:0:7934:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103fa65c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7934:1876180414301952:192.168.203.37@tcp:105: 00010000:00010000:3.0:1789265298.596738:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb95269e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.596750:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb95269e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.596792:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8000/0x27274ba5bb952762 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.596810:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8000/0x27274ba5bb952762 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.596824:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8000/0x27274ba5bb952762 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.596835:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8000/0x27274ba5bb952762 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.596841:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8000/0x27274ba5bb952762 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.596848:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8000/0x27274ba5bb952762 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.596855:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fae8000 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789265298.596859:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8000/0x27274ba5bb952762 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.596884:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8000/0x27274ba5bb952762 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.596897:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a1012931800) 00010000:00010000:3.0:1789265298.596900:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265298.596904:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8000/0x27274ba5bb952762 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.596910:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8000/0x27274ba5bb952762 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.596920:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb952754 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.596926:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb952754 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.596933:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb952754 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.596937:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fae9a00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789265298.596940:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb952754 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.596945:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb952754 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.596951:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a1012931800) 00010000:00010000:3.0:1789265298.596953:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789265298.596956:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb952754 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.596972:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb952754 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265298.597462:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bcc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+18:10518:x1876180397516160:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 Request processed in 18582us (18763us total) trans 4294967407 rc 0/0 00000100:00100000:3.0:1789265298.597475:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 127 00000020:00080000:3.0:1789265298.597483:0:7934:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789265298.597851:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789265298.597858:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789265298.598717:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1789265298.598732:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789265298.599718:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397516416 00000100:00100000:1.0:1789265298.599734:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397516416 00000100:00100000:1.0:1789265298.599861:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 31 00000100:00100000:1.0:1789265298.599874:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1034af8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+18:10517:x1876180397516416:12345-192.168.203.37@tcp:49:lfs.0 00000100:00100000:1.0:1789265298.600103:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1034af8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+18:10517:x1876180397516416:12345-192.168.203.37@tcp:49:lfs.0 Request processed in 230us (3633us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265298.600144:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 31 00000100:00100000:0.0:1789265298.605007:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265298.605069:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265298.605206:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397516672 00000100:00100000:2.0:1789265298.605220:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397516672 00000100:00100000:3.0:1789265298.605287:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397516928 00000100:00100000:2.0:1789265298.605292:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 128 00000100:00100000:3.0:1789265298.605293:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397516928 00000100:00100000:2.0:1789265298.605302:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1034afa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+19:10517:x1876180397516672:12345-192.168.203.37@tcp:58:lfs.0 00000100:00100000:3.0:1789265298.605317:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 32 00000100:00100000:3.0:1789265298.605323:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1010a41050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+19:10518:x1876180397516928:12345-192.168.203.37@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789265298.606309:0:5844:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789265298.606437:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967408 00010000:00010000:3.0:1789265298.606498:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8400/0x27274ba5bb952769 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.606521:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8400/0x27274ba5bb952769 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.606537:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8400/0x27274ba5bb952769 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.606548:0:5844:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8400/0x27274ba5bb952769 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.606556:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8400/0x27274ba5bb952769 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.606563:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8400/0x27274ba5bb952769 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.606588:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789265298.606669:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265298.606678:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8400/0x27274ba5bb952769 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.606686:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fae8400 already unused, calling callback (ffffffffc1581350) 00010000:00010000:0.0:1789265298.606690:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8400/0x27274ba5bb952769 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.606699:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8400/0x27274ba5bb952769 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.606715:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8a1032d00a00) 00010000:00010000:0.0:1789265298.606726:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789265298.606732:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8400/0x27274ba5bb952769 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.606738:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8400/0x27274ba5bb952769 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.606761:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265298.606763:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265298.606764:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789265298.611467:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1789265298.611566:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1034afa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+21:10517:x1876180397516672:12345-192.168.203.37@tcp:58:lfs.0 Request processed in 6250us (6570us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265298.611606:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 128 00000100:00100000:3.0:1789265298.612912:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1010a41050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+20:10518:x1876180397516928:12345-192.168.203.37@tcp:35:lhsmtool_posix.0 Request processed in 6066us (6319us total) trans 4294967409 rc 0/0 00000100:00100000:3.0:1789265298.612929:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 32 00000020:00080000:3.0:1789265298.612936:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789265298.644136:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265298.644226:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397517056 00000100:00100000:2.0:1789265298.644240:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397517056 00000100:00100000:2.0:1789265298.644320:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 129 00000100:00100000:2.0:1789265298.644333:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1034af8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+20:10520:x1876180397517056:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:2.0:1789265298.644378:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265298.644408:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952770 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99eff80 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.644493:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952777 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.644524:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952777 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.644538:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952777 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.644555:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb95277e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.644629:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb95277e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.644638:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb95277e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.644971:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7600/0x27274ba5bb952785 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.645524:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb952690 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff41 expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.645535:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7600/0x27274ba5bb952785 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.645717:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb952690 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff41 expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265298.645743:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb952690 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff41 expref: 21 pid: 5842 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265298.645762:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1009071500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1876180414302080:192.168.203.37@tcp:104: 00000100:00100000:2.0:1789265298.645958:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a102ec330c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265298.651939:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265298.652290:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397517312 00000100:00100000:1.0:1789265298.652300:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397517312 00000100:00100000:2.0:1789265298.652820:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1009071500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1876180414302080:192.168.203.37@tcp:104: 00010000:00010000:2.0:1789265298.652862:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7600/0x27274ba5bb952785 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265298.653046:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 33 00000100:00100000:1.0:1789265298.653066:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1034af9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+22:9216:x1876180397517312:12345-192.168.203.37@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789265298.653497:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1034af9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+23:9216:x1876180397517312:12345-192.168.203.37@tcp:35:ldlm_bl.0 Request processed in 437us (1571us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1789265298.654973:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 33 00000100:00100000:0.0:1789265298.656723:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265298.656860:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397517440 00000100:00100000:3.0:1789265298.656874:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397517440 00010000:00010000:3.0:1789265298.656935:0:8490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb952690 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff41 expref: 23 pid: 5842 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265298.657123:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 60 00000100:00100000:3.0:1789265298.657147:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10118e4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+23:2351:x1876180397517440:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265298.657166:0:8490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265298.657174:0:8490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb952690 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff41 expref: 23 pid: 5842 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.657194:0:8490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb952690 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff41 expref: 23 pid: 5842 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.657224:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb952690 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff41 expref: 23 pid: 5842 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.657243:0:8490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a1012931800) 00010000:00010000:3.0:1789265298.657249:0:8490:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7600/0x27274ba5bb952785 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.657261:0:8490:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7600/0x27274ba5bb952785 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.657289:0:8490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7600/0x27274ba5bb952785 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265298.657390:0:8490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265298.657474:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10118e4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+22:2351:x1876180397517440:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 330us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265298.657482:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 60 00010000:00010000:0.0:1789265298.657729:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7600/0x27274ba5bb952785 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.657738:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7600/0x27274ba5bb952785 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265298.657797:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789265298.657803:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789265298.657833:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7600/0x27274ba5bb952785 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.657851:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7600/0x27274ba5bb952785 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.657863:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952777 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.657870:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952777 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.657892:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952777 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.657899:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad6000 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789265298.657903:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952777 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.657912:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952777 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.657925:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a101b706300) 00010000:00010000:0.0:1789265298.657928:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265298.657933:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952777 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.657940:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952777 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.657956:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb95277e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.657963:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb95277e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.657969:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb95277e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.657975:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad6c00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789265298.657978:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb95277e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.658170:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb95277e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.658181:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8a1012931300) 00010000:00010000:0.0:1789265298.658183:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265298.658186:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb95277e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.658193:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb95277e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.658242:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952770 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff80 expref: 22 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.658256:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7600/0x27274ba5bb952785 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff80 expref: 21 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265298.658263:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a1012931800) 00010000:00010000:0.0:1789265298.658265:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789265298.658267:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fad7600, rc 0) 00000100:00100000:0.0:1789265298.658311:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1034af8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+21:10520:x1876180397517056:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 13982us (14254us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265298.658319:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 129 00010000:00010000:0.0:1789265298.738921:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789265299.634950:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789265299.634961:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789265299.635012:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1789265299.635019:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789265299.635743:0:11671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1009071500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11671:1876180414302208:192.168.203.37@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789265299.635871:0:11671:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1004df9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789265299.649506:0:11671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1009071500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11671:1876180414302208:192.168.203.37@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789265299.654292:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265299.667402:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397517568 00000100:00100000:0.0:1789265299.667418:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397517568 00000100:00100000:1.0:1789265299.667565:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 130 00000100:00100000:1.0:1789265299.667576:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bcc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+21:10531:x1876180397517568:12345-192.168.203.37@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789265299.667611:0:7934:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789265299.667729:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bcc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+21:10531:x1876180397517568:12345-192.168.203.37@tcp:53:lhsmtool_posix.0 Request processed in 154us (13446us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265299.667737:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 130 00000100:00100000:3.0:1789265299.683316:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265299.683358:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397517824 00000100:00100000:3.0:1789265299.683368:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397517824 00000100:00100000:3.0:1789265299.683421:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 131 00000100:00100000:3.0:1789265299.683430:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103fa65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+21:10531:x1876180397517824:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789265299.683450:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265299.683471:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb95278c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99eff87 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265299.683574:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb952793 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265299.683590:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb952793 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265299.683605:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb952793 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265299.683616:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789265299.684068:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb95278c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff87 expref: 24 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265299.684135:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb952793 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff87 expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265299.684145:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a1012931800) 00010000:00010000:3.0:1789265299.684148:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789265299.684152:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fae9a00, rc 0) 00000100:00100000:3.0:1789265299.684226:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103fa65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+23:10531:x1876180397517824:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 796us (920us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1789265299.684235:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 131 00000100:00100000:2.0:1789265299.691649:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265299.691712:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265299.691758:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397517952 00000100:00100000:2.0:1789265299.691768:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397517952 00000100:00100000:2.0:1789265299.691826:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 9 00000100:00100000:2.0:1789265299.691837:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1009071500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+23:2351:x1876180397517952:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265299.691851:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265299.691875:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb952793 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff87 expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265299.691892:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a1012931800) 00010000:00010000:2.0:1789265299.691896:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265299.691944:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1009071500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+22:2351:x1876180397517952:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 109us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265299.691952:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 9 00000100:00100000:1.0:1789265299.692915:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397518208 00000100:00100000:1.0:1789265299.692925:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397518208 00000100:00100000:1.0:1789265299.692978:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 132 00000100:00100000:1.0:1789265299.692987:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1009071180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+22:10531:x1876180397518208:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789265299.693069:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb9527a1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265299.693103:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb9527a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265299.693115:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb9527a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265299.693317:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb9527a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265299.693326:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb9527a1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265299.693333:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb9527a1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265299.693339:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b596600 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789265299.693343:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb9527a1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265299.693350:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb9527a1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265299.693361:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a1012931800) 00010000:00010000:1.0:1789265299.693363:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789265299.693367:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb9527a1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265299.693373:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb9527a1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265299.693500:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1009071180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+23:10531:x1876180397518208:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 Request processed in 513us (1786us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1789265299.693508:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 132 00000040:00080000:1.0:1789265299.693795:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789265299.693800:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789265299.694351:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1789265299.694371:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1789265299.696023:0:12045:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789265299.696031:0:12045:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:2.0:1789265299.696749:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265299.699625:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397518464 00000100:00100000:0.0:1789265299.699639:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397518464 00000100:00100000:0.0:1789265299.699700:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 34 00000100:00100000:0.0:1789265299.699710:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008754700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+23:10531:x1876180397518464:12345-192.168.203.37@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789265299.699976:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008754700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+24:10531:x1876180397518464:12345-192.168.203.37@tcp:35:lhsmtool_posix.0 Request processed in 266us (3233us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1789265299.699983:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 34 00000040:00080000:1.0:1789265299.701467:0:12045:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789265299.701477:0:12045:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789265299.768696:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265299.914294:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265299.914419:0:11857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397518720 00000100:00100000:0.0:1789265299.914429:0:11857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397518720 00000100:00100000:0.0:1789265299.914488:0:11857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 133 00000100:00100000:0.0:1789265299.914499:0:11857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bcc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+24:10544:x1876180397518720:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:0.0:1789265299.914526:0:11857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265299.914546:0:11857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35000/0x27274ba5bb9527a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99eff8e expref: -99 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265299.914642:0:11857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34600/0x27274ba5bb9527af lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265299.914657:0:11857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34600/0x27274ba5bb9527af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265299.914669:0:11857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34600/0x27274ba5bb9527af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265299.914679:0:11857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1789265299.914794:0:11857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35000/0x27274ba5bb9527a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff8e expref: 27 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265299.914831:0:11857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34600/0x27274ba5bb9527af lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff8e expref: 26 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265299.914839:0:11857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a1012931800) 00010000:00010000:0.0:1789265299.914842:0:11857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789265299.914845:0:11857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fa34600, rc 0) 00000100:00100000:0.0:1789265299.914904:0:11857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bcc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+26:10544:x1876180397518720:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 408us (619us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1789265299.914912:0:11857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 133 00000100:00100000:3.0:1789265299.918517:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265299.918592:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397518848 00000100:00100000:0.0:1789265299.918601:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397518848 00000100:00100000:0.0:1789265299.918659:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 134 00000100:00100000:0.0:1789265299.918670:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103fa65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+26:10544:x1876180397518848:12345-192.168.203.37@tcp:54:lfs.0 00010000:00010000:0.0:1789265299.918737:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34200/0x27274ba5bb9527bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265299.918754:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34200/0x27274ba5bb9527bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265299.918765:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34200/0x27274ba5bb9527bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265299.918792:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34200/0x27274ba5bb9527bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265299.918799:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34200/0x27274ba5bb9527bd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265299.918819:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34200/0x27274ba5bb9527bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265299.918824:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fa34200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789265299.918829:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34200/0x27274ba5bb9527bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265299.918836:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34200/0x27274ba5bb9527bd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265299.918848:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a1012931800) 00010000:00010000:0.0:1789265299.918850:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789265299.918854:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34200/0x27274ba5bb9527bd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265299.918860:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34200/0x27274ba5bb9527bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265299.918932:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103fa65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+26:10544:x1876180397518848:12345-192.168.203.37@tcp:54:lfs.0 Request processed in 264us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265299.918940:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 134 00000100:00100000:2.0:1789265300.077751:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265300.077887:0:12007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397518976 00000100:00100000:3.0:1789265300.077897:0:12007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397518976 00000100:00100000:3.0:1789265300.077978:0:12007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 46 00000100:00100000:3.0:1789265300.077997:0:12007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1010f80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:2350:x1876180397518976:12345-192.168.203.37@tcp:101:cat.0 00010000:00010000:3.0:1789265300.078017:0:12007:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265300.078037:0:12007:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0b070fb/0x27274ba5bb9527c4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99eff95 expref: -99 pid: 12007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789265300.078064:0:12007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa60591, atime: 0x6aa60591, ctime: 0x6aa60591, blocks: 0xb 00010000:00010000:3.0:1789265300.078114:0:12007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=345s v=(0 0) 00010000:00010000:3.0:1789265300.078129:0:12007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265300.078139:0:12007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0b070fb/0x27274ba5bb9527c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff95 expref: 7 pid: 12007 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265300.078160:0:12007:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c0b070fb/0x27274ba5bb9527c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff95 expref: 7 pid: 12007 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265300.078359:0:12007:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fae8000, rc 0) 00000100:00080000:0.0:1789265300.078478:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789265300.078513:0:12007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1010f80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+7:2350:x1876180397518976:12345-192.168.203.37@tcp:101:cat.0 Request processed in 525us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265300.078622:0:12007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 46 00000100:00100000:1.0:1789265300.088780:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265300.088868:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397519104 00000100:00100000:0.0:1789265300.088878:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397519104 00002000:00100000:0.0:1789265300.088923:0:6689:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff8a103bcc5f80 x1876180397519104/t0(0) o3->4b820fcb-1bab-4b78-bfa4-355c22a09cf8@192.168.203.37@tcp:626/0 lens 488/0 e 0 to 0 dl 1789265311 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789265300.088933:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a103bcc5f80 with x1876180397519104 ext(0->4095) 00002000:00010000:0.0:1789265300.088939:0:6689:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a103bcc5f80 00000100:00100000:0.0:1789265300.089801:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 3 00000100:00100000:0.0:1789265300.089825:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bcc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+7:2350:x1876180397519104:12345-192.168.203.37@tcp:3:cat.0 00000100:00100000:0.0:1789265300.090024:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bcc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+7:2350:x1876180397519104:12345-192.168.203.37@tcp:3:cat.0 Request processed in 201us (1253us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789265300.090032:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 3 00002000:00100000:0.0:1789265300.090038:0:6689:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff8a103bcc5f80 x1876180397519104/t0(0) o3->4b820fcb-1bab-4b78-bfa4-355c22a09cf8@192.168.203.37@tcp:626/0 lens 488/4536 e 0 to 0 dl 1789265311 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789265300.090047:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a103bcc5f80 with x1876180397519104 ext(0->4095) 00002000:00010000:0.0:1789265300.090051:0:6689:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a103bcc5f80 00000100:00100000:0.0:1789265300.274814:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789265300.274837:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10091e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414302336:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789265300.274906:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265300.275104:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414302336 00000100:00100000:3.0:1789265300.275113:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414302336 00000100:00100000:3.0:1789265300.275189:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789265300.275198:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1034afaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1876180414302336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789265300.275229:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789265300.275280:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1034afaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1876180414302336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265300.275287:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789265300.275334:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10091e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414302336:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789265300.275621:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789265300.787096:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265301.310529:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789265301.315152:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103bee1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876180414302592:0@lo:400:kworker.0 00000100:00100000:0.0:1789265301.315257:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265301.315353:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10091e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:871daf34-1206-40e7-bd71-78303abe4d37:3316:1876180414302464:0@lo:400:kworker.0 00000100:00100000:0.0:1789265301.315389:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265301.315604:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414302592 00000100:00100000:2.0:1789265301.315615:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414302592 00000100:00100000:2.0:1789265301.315682:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789265301.315693:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1034afa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876180414302592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265301.315766:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1034afa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876180414302592:12345-0@lo:400:kworker.0 Request processed in 74us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265301.315774:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789265301.315815:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414302464 00000100:00100000:2.0:1789265301.315819:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414302464 00000100:00100000:2.0:1789265301.315847:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1789265301.315854:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+19:3316:x1876180414302464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265301.315908:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+19:3316:x1876180414302464:12345-0@lo:400:kworker.0 Request processed in 53us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265301.315914:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1789265301.316071:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103bee1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876180414302592:0@lo:400:kworker.0 00000100:00100000:2.0:1789265301.316118:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10091e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:871daf34-1206-40e7-bd71-78303abe4d37:3316:1876180414302464:0@lo:400:kworker.0 00000100:00100000:3.0:1789265301.317484:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103bee3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1876180414302720:0@lo:400:kworker.0 00000100:00100000:3.0:1789265301.317559:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265301.317816:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414302720 00000100:00100000:3.0:1789265301.317824:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414302720 00000100:00100000:3.0:1789265301.317896:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789265301.317907:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bee1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876180414302720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265301.318240:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bee1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876180414302720:12345-0@lo:400:kworker.0 Request processed in 334us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265301.318254:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789265301.318311:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1016d45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414302848:0@lo:400:kworker.0 00000100:00100000:3.0:1789265301.318362:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265301.318685:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103bee3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1876180414302720:0@lo:400:kworker.0 00000100:00100000:2.0:1789265301.318718:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414302848 00000100:00100000:2.0:1789265301.318723:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414302848 00000100:00100000:2.0:1789265301.318762:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789265301.318781:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1016d44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3318:x1876180414302848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265301.318837:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1016d44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3318:x1876180414302848:12345-0@lo:400:kworker.0 Request processed in 58us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265301.318843:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:1.0:1789265301.318851:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265301.318876:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1016d45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414302848:0@lo:400:kworker.0 00000100:00100000:2.0:1789265301.318894:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1016d45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1876180414302976:0@lo:400:kworker.0 00000100:00100000:2.0:1789265301.318926:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265301.318949:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789265301.318968:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102e766d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414303104:0@lo:400:kworker.0 00000100:00100000:2.0:1789265301.318993:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265301.319024:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414302976 00000100:00100000:2.0:1789265301.319028:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414302976 00000100:00100000:2.0:1789265301.319060:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789265301.319066:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1010f81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876180414302976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265301.319137:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1010f81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876180414302976:12345-0@lo:400:kworker.0 Request processed in 70us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265301.319153:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:2.0:1789265301.319169:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265301.319189:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1016d45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1876180414302976:0@lo:400:kworker.0 00000100:00100000:0.0:1789265301.319782:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414303104 00000100:00100000:0.0:1789265301.319790:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414303104 00000100:00100000:0.0:1789265301.320215:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789265301.320225:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1010f83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3315:x1876180414303104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265301.320302:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1010f83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3315:x1876180414303104:12345-0@lo:400:kworker.0 Request processed in 78us (1307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265301.320309:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789265301.320367:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102e766d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414303104:0@lo:400:kworker.0 00000100:00080000:3.0:1789265301.320484:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789265301.767649:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265301.767704:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265301.767710:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397519232 00000100:00100000:2.0:1789265301.767723:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397519232 00000100:00100000:1.0:1789265301.767736:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265301.767769:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265301.767797:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265301.767798:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 285 00000100:00100000:2.0:1789265301.767811:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1230cd-a81b-4bcc-a532-e24f5353fef4+13:2349:x1876180397519232:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789265301.767912:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1230cd-a81b-4bcc-a532-e24f5353fef4+13:2349:x1876180397519232:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 104us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265301.767920:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 285 00000100:00100000:2.0:1789265301.767961:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397519488 00000100:00100000:2.0:1789265301.767965:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397519488 00000100:00100000:2.0:1789265301.768023:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397519616 00000100:00100000:2.0:1789265301.768026:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397519616 00000100:00100000:2.0:1789265301.768048:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 73 00000100:00100000:2.0:1789265301.768054:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bcc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+5:2349:x1876180397519488:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789265301.768121:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bcc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+5:2349:x1876180397519488:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 66us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265301.768129:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 73 00000100:00100000:2.0:1789265301.768141:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 74 00000100:00100000:2.0:1789265301.768147:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bcc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+7:2349:x1876180397519616:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789265301.768171:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bcc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+7:2349:x1876180397519616:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 25us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265301.768177:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 74 00000100:00080000:2.0:1789265301.768213:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265301.768915:0:11857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397519744 00000100:00100000:1.0:1789265301.768925:0:11857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397519744 00000100:00100000:1.0:1789265301.768970:0:11857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397519360 00000100:00100000:1.0:1789265301.768973:0:11857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397519360 00000100:00100000:1.0:1789265301.768998:0:11857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 128 00000100:00100000:1.0:1789265301.769006:0:11857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bcc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+5:2349:x1876180397519744:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789265301.769062:0:11857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bcc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+5:2349:x1876180397519744:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 56us (1324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265301.769067:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 129 00000100:00100000:1.0:1789265301.769072:0:11857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 128 00000100:00100000:2.0:1789265301.769096:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bcc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+26:2349:x1876180397519360:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789265301.769136:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bcc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+26:2349:x1876180397519360:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 61us (1365us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265301.769142:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 129 00000100:00080000:2.0:1789265301.769159:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789265301.810344:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265301.814192:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102e765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414303232:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789265301.814290:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265301.814534:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414303232 00000100:00100000:3.0:1789265301.814550:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414303232 00000100:00100000:3.0:1789265301.814608:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789265301.814619:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102e764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1876180414303232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789265301.814663:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789265301.814714:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102e764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1876180414303232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265301.814721:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789265301.814780:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102e765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414303232:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789265302.851230:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789265303.451193:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00010000:00010000:2.0:1789265303.859114:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789265303.948159:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:2.0:1789265303.948192:0:5863:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:2.0:1789265303.948221:0:5863:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8a1002cd7180 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1789265303.948226:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a1002ec0a00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8a1002cd7840 00000020:00080000:2.0:1789265303.948230:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a1002ec0f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8a1016d71400 00000020:00080000:0.0:1789265303.948377:0:5874:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1789265303.948575:0:5874:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:2.0:1789265303.976221:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:2.0:1789265303.976257:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00010000:00010000:0.0:1789265304.894134:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265305.211912:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265305.212000:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397519872 00000100:00100000:2.0:1789265305.212011:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397519872 00000100:00100000:2.0:1789265305.212118:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 135 00000100:00100000:2.0:1789265305.212132:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c0d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+13:10206:x1876180397519872:12345-192.168.203.37@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789265305.212247:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c0d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+13:10206:x1876180397519872:12345-192.168.203.37@tcp:60:lhsmtool_posix.0 Request processed in 119us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265305.212256:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 135 00000100:00080000:0.0:1789265305.212338:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265305.218212:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265305.218523:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397520128 00000100:00100000:0.0:1789265305.218548:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397520128 00000100:00100000:0.0:1789265305.218662:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 35 00000100:00100000:0.0:1789265305.218674:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c0d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+13:10206:x1876180397520128:12345-192.168.203.37@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789265305.219037:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c0d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+14:10206:x1876180397520128:12345-192.168.203.37@tcp:35:lhsmtool_posix.0 Request processed in 365us (842us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1789265305.219045:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 35 00000100:00100000:2.0:1789265305.396162:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102e765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414303360:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789265305.396247:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265305.397869:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414303360 00000100:00100000:3.0:1789265305.397883:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414303360 00000100:00100000:3.0:1789265305.398015:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789265305.398025:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1010f83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876180414303360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789265305.398063:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789265305.398174:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1010f83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876180414303360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 151us (1937us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265305.398182:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789265305.398272:0:3318:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1789265305.398278:0:3318:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a103bcc4380, transno 4294967304 00000100:00100000:1.0:1789265305.398313:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102e765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414303360:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789265305.398704:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265305.782893:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265305.783044:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397520256 00000100:00100000:2.0:1789265305.783066:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397520256 00000100:00100000:2.0:1789265305.783227:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 136 00000100:00100000:2.0:1789265305.783239:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102e765500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+5:10999:x1876180397520256:12345-192.168.203.37@tcp:101:lsof.0 00010000:00010000:2.0:1789265305.783258:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265305.783277:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb9527cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99eff9c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265305.783339:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb9527d2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265305.783352:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb9527d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265305.783364:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb9527d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265305.783398:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789265305.783401:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789265305.783441:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb9527d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265305.783464:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb9527cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff9c expref: 7 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265305.783481:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb9527d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff9c expref: 6 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265305.783490:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a101b706400) 00010000:00010000:2.0:1789265305.783493:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789265305.783497:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fad7400, rc 0) 00000100:00100000:2.0:1789265305.783570:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102e765500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+6:10999:x1876180397520256:12345-192.168.203.37@tcp:101:lsof.0 Request processed in 333us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265305.783578:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 136 00000100:00080000:0.0:1789265305.786867:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789265305.906261:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265306.418554:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789265306.418676:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789265306.418697:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1034afad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876180414303616:0@lo:400:kworker.0 00000100:00100000:2.0:1789265306.418762:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265306.419218:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414303616 00000100:00100000:1.0:1789265306.419422:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414303616 00000100:00100000:3.0:1789265306.419819:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1034af9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:871daf34-1206-40e7-bd71-78303abe4d37:3316:1876180414303488:0@lo:400:kworker.0 00000100:00100000:3.0:1789265306.419872:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265306.419920:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414303488 00000100:00100000:3.0:1789265306.419932:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414303488 00000100:00100000:3.0:1789265306.419966:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1789265306.419975:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+19:3316:x1876180414303488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265306.420028:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+19:3316:x1876180414303488:12345-0@lo:400:kworker.0 Request processed in 54us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265306.420036:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1789265306.420105:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1034af9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:871daf34-1206-40e7-bd71-78303abe4d37:3316:1876180414303488:0@lo:400:kworker.0 00000100:00100000:1.0:1789265306.420217:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789265306.420227:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1010f81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876180414303616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265306.420288:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1010f81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876180414303616:12345-0@lo:400:kworker.0 Request processed in 64us (1527us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265306.420295:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789265306.421435:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1034afad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876180414303616:0@lo:400:kworker.0 00000100:00100000:3.0:1789265306.422585:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1034af8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1876180414303744:0@lo:400:kworker.0 00000100:00100000:3.0:1789265306.422721:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265306.428872:0:11857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414303744 00000100:00100000:2.0:1789265306.428888:0:11857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414303744 00000100:00100000:2.0:1789265306.428969:0:11857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789265306.428981:0:11857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102e766d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876180414303744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265306.429243:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1034af8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414303872:0@lo:400:kworker.0 00000100:00100000:1.0:1789265306.429290:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265306.429338:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414303872 00000100:00100000:1.0:1789265306.429342:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414303872 00000100:00100000:1.0:1789265306.429372:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789265306.429379:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bcc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1876180414303872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265306.431067:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bcc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1876180414303872:12345-0@lo:400:kworker.0 Request processed in 1681us (1769us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265306.431104:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789265306.431173:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1034af8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414303872:0@lo:400:kworker.0 00000100:00080000:1.0:1789265306.431231:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265306.434758:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1034afad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414304128:0@lo:400:kworker.0 00000100:00100000:0.0:1789265306.434830:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265306.434876:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789265306.434882:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1034af8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1876180414304000:0@lo:400:kworker.0 00000100:00100000:0.0:1789265306.434908:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265306.434947:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414304128 00000100:00100000:0.0:1789265306.434954:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414304128 00000100:00100000:0.0:1789265306.435005:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789265306.435014:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1034af9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414304128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265306.435063:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1034af9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414304128:12345-0@lo:400:kworker.0 Request processed in 49us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265306.435070:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789265306.435135:0:3316:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:0.0:1789265306.435155:0:3316:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a103fb32680, transno 4294967310 00000004:00080000:0.0:1789265306.435166:0:3316:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:0.0:1789265306.435189:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1034afad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414304128:0@lo:400:kworker.0 00000100:00100000:0.0:1789265306.435535:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414304000 00000100:00100000:0.0:1789265306.435540:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414304000 00000100:00100000:0.0:1789265306.435571:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789265306.435578:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008e25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876180414304000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265306.435616:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008e25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876180414304000:12345-0@lo:400:kworker.0 Request processed in 38us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265306.435622:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789265306.435646:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1034af8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1876180414304000:0@lo:400:kworker.0 00000100:00080000:1.0:1789265306.440865:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789265306.440877:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789265306.441151:0:11857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102e766d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876180414303744:12345-0@lo:400:kworker.0 Request processed in 12168us (18424us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265306.441165:0:11857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789265306.441595:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1034af8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1876180414303744:0@lo:400:kworker.0 00000100:00100000:2.0:1789265306.864456:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265306.864501:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265306.864532:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265306.864564:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265306.864586:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265306.864767:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397520384 00000100:00100000:0.0:1789265306.864777:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397520384 00000100:00100000:0.0:1789265306.864830:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 287 00000100:00100000:0.0:1789265306.864840:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+13:2349:x1876180397520384:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789265306.864906:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+13:2349:x1876180397520384:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 68us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265306.864912:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 287 00000100:00100000:1.0:1789265306.865152:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397520768 00000100:00100000:1.0:1789265306.865157:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397520768 00000100:00100000:1.0:1789265306.865207:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397520640 00000100:00100000:1.0:1789265306.865210:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397520640 00000100:00100000:1.0:1789265306.865233:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 77 00000100:00100000:1.0:1789265306.865239:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1016d45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:2349:x1876180397520768:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789265306.865275:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1016d45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:2349:x1876180397520768:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 36us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265306.865297:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 77 00000100:00100000:1.0:1789265306.865310:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 78 00000100:00100000:1.0:1789265306.865316:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bee3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+5:2349:x1876180397520640:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789265306.865353:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bee3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+5:2349:x1876180397520640:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 37us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265306.865359:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 78 00000100:00100000:1.0:1789265306.865774:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397520512 00000100:00100000:1.0:1789265306.865779:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397520512 00000100:00100000:1.0:1789265306.865806:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397520896 00000100:00100000:1.0:1789265306.865810:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397520896 00000100:00100000:1.0:1789265306.865827:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 133 00000100:00100000:1.0:1789265306.865834:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1016d45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+14:2349:x1876180397520512:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789265306.865871:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1016d45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+14:2349:x1876180397520512:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 37us (1425us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265306.865878:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 133 00000100:00100000:1.0:1789265306.865890:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 134 00000100:00100000:1.0:1789265306.865897:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10091eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+6:2349:x1876180397520896:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789265306.865922:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10091eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+6:2349:x1876180397520896:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 25us (1335us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265306.865928:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 134 00000100:00080000:0.0:1789265306.866010:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789265306.866015:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:1.0:1789265306.866831:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789265306.866838:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789265306.866877:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789265306.866884:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789265306.930499:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789265306.930525:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c07a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414304256:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789265306.930597:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265306.930987:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414304256 00000100:00100000:3.0:1789265306.930995:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414304256 00000100:00100000:3.0:1789265306.931048:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789265306.931057:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10091e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876180414304256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789265306.931120:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789265306.931180:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10091e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876180414304256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265306.931187:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00010000:0.0:1789265306.931222:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265306.931230:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c07a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414304256:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789265307.954232:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265308.981336:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789265309.055188:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:1.0:1789265309.055274:0:5863:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1789265309.055309:0:5874:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1789265309.055322:0:5874:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:02000400:2.0:1789265309.738029:0:12248:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 22:08:28 (1789265308) 00010000:00010000:3.0:1789265310.018901:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265310.514471:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789265310.514522:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c07a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414304384:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789265310.514632:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265310.514837:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414304384 00000100:00100000:3.0:1789265310.514859:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414304384 00000100:00100000:3.0:1789265310.514940:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789265310.514950:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c0d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876180414304384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789265310.515034:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789265310.515134:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c0d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876180414304384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 183us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265310.515147:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789265310.515193:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c07a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414304384:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789265310.515603:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789265311.026329:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265311.538676:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10037b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414304896:0@lo:400:kworker.0 00000100:00100000:3.0:1789265311.538744:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265311.538805:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789265311.538812:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1876180414304768:0@lo:400:kworker.0 00000100:00100000:3.0:1789265311.538838:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265311.538917:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c07bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:871daf34-1206-40e7-bd71-78303abe4d37:3315:1876180414304512:0@lo:400:kworker.0 00000100:00100000:1.0:1789265311.538950:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265311.538980:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10037b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1876180414305024:0@lo:400:kworker.0 00000100:00100000:1.0:1789265311.539021:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265311.539051:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789265311.539057:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c07a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876180414304640:0@lo:400:kworker.0 00000100:00100000:1.0:1789265311.539102:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265311.539121:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103bb05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414305152:0@lo:400:kworker.0 00000100:00100000:1.0:1789265311.539142:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265311.539169:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414304896 00000100:00100000:1.0:1789265311.539176:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414304896 00000100:00100000:1.0:1789265311.539215:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414305152 00000100:00100000:1.0:1789265311.539219:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414305152 00000100:00100000:1.0:1789265311.539245:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789265311.539254:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bb04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1876180414304896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265311.539303:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bb04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1876180414304896:12345-0@lo:400:kworker.0 Request processed in 50us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265311.539310:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789265311.539341:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789265311.539347:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10031fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414305152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265311.539379:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10031fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414305152:12345-0@lo:400:kworker.0 Request processed in 32us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265311.539399:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789265311.539418:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414304768 00000100:00100000:1.0:1789265311.539421:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414304768 00000100:00100000:1.0:1789265311.539442:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414305024 00000100:00100000:1.0:1789265311.539445:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414305024 00000100:00100000:1.0:1789265311.539459:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414304640 00000100:00100000:1.0:1789265311.539461:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414304640 00000100:00100000:1.0:1789265311.539474:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789265311.539480:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bb05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1876180414304768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265311.539511:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bb05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1876180414304768:12345-0@lo:400:kworker.0 Request processed in 31us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265311.539517:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789265311.539529:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789265311.539535:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10031fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876180414305024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265311.539561:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10031fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876180414305024:12345-0@lo:400:kworker.0 Request processed in 26us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265311.539567:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789265311.539578:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789265311.539584:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10031fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876180414304640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265311.539611:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10031fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876180414304640:12345-0@lo:400:kworker.0 Request processed in 27us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265311.539616:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789265311.539660:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c07a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876180414304640:0@lo:400:kworker.0 00000100:00100000:1.0:1789265311.539671:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103bb05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414305152:0@lo:400:kworker.0 00000100:00100000:1.0:1789265311.539680:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10037b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1876180414305024:0@lo:400:kworker.0 00000100:00080000:0.0:1789265311.540052:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789265311.540064:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789265311.540492:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414304512 00000100:00100000:3.0:1789265311.540499:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414304512 00000100:00100000:3.0:1789265311.540539:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1789265311.540547:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+19:3315:x1876180414304512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265311.540604:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+19:3315:x1876180414304512:12345-0@lo:400:kworker.0 Request processed in 58us (1653us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265311.540612:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1789265311.540656:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1876180414304768:0@lo:400:kworker.0 00000100:00100000:3.0:1789265311.540666:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10037b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414304896:0@lo:400:kworker.0 00000100:00100000:1.0:1789265311.545792:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c07bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:871daf34-1206-40e7-bd71-78303abe4d37:3315:1876180414304512:0@lo:400:kworker.0 00000100:00100000:3.0:1789265311.599158:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265311.599585:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397521152 00000100:00100000:1.0:1789265311.599597:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397521152 00000100:00100000:1.0:1789265311.599680:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 137 00000100:00100000:1.0:1789265311.599700:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bb04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+13:11264:x1876180397521152:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789265311.599719:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265311.599742:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb9527d9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99effa3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265311.599815:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb9527e0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265311.599829:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb9527e0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265311.599844:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb9527e0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265311.599859:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596e00/0x27274ba5bb9527e7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265311.599866:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596e00/0x27274ba5bb9527e7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265311.599872:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596e00/0x27274ba5bb9527e7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265311.600121:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb9527ee lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265311.600142:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb9527ee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265311.600149:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb9527ee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265311.600158:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1789265311.600301:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb9527e0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265311.600309:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb9527e0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265311.600329:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb9527e0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265311.600334:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b596600 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789265311.600339:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb9527e0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265311.600345:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb9527e0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265311.600356:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8a1012931500) 00010000:00010000:1.0:1789265311.600359:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265311.600364:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb9527e0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265311.600370:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb9527e0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265311.600381:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596e00/0x27274ba5bb9527e7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265311.600393:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596e00/0x27274ba5bb9527e7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265311.600399:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596e00/0x27274ba5bb9527e7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265311.600404:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b596e00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789265311.600407:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596e00/0x27274ba5bb9527e7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265311.600413:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596e00/0x27274ba5bb9527e7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265311.600421:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8a101cdf4700) 00010000:00010000:1.0:1789265311.600424:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265311.600427:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596e00/0x27274ba5bb9527e7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265311.600433:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596e00/0x27274ba5bb9527e7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265311.600811:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb9527d9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99effa3 expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265311.600826:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb9527ee lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99effa3 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265311.600834:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a1032d00f00) 00010000:00010000:1.0:1789265311.600836:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265311.600844:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a101b597800, rc 0) 00000100:00100000:1.0:1789265311.600914:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bb04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+15:11264:x1876180397521152:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 1225us (1764us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1789265311.600922:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 137 00000100:00080000:2.0:1789265311.601317:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265311.611180:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265311.611219:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265311.611307:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397521280 00000100:00100000:0.0:1789265311.611307:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397521408 00000100:00100000:3.0:1789265311.611317:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397521280 00000100:00100000:3.0:1789265311.611397:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 10 00000100:00100000:3.0:1789265311.611409:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1041b72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+15:2349:x1876180397521280:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265311.611425:0:8490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789265311.611426:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397521408 00010000:00010000:3.0:1789265311.611449:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb9527ee lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99effa3 expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265311.611636:0:8490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a1032d00f00) 00010000:00010000:3.0:1789265311.611642:0:8490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265311.611702:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1041b72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+15:2349:x1876180397521280:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 295us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265311.611710:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 10 00000100:00100000:0.0:1789265311.612436:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 138 00000100:00100000:0.0:1789265311.612449:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1041b73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+14:11264:x1876180397521408:12345-192.168.203.37@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789265311.612530:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1041b73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+14:11264:x1876180397521408:12345-192.168.203.37@tcp:59:lhsmtool_posix.0 Request processed in 85us (1310us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265311.612537:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 138 00000100:00100000:0.0:1789265311.984981:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265311.985118:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265311.985141:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265311.985177:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265311.985192:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397521792 00000100:00100000:1.0:1789265311.985203:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397521792 00000100:00100000:1.0:1789265311.985289:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397521664 00000100:00100000:1.0:1789265311.985293:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397521664 00000100:00100000:1.0:1789265311.985330:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 81 00000100:00100000:1.0:1789265311.985341:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1034af8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:2350:x1876180397521792:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789265311.985410:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1034af8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:2350:x1876180397521792:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 71us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265311.985418:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 81 00000100:00100000:1.0:1789265311.985435:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 82 00000100:00100000:1.0:1789265311.985442:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1034af8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+5:2350:x1876180397521664:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789265311.985467:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1034af8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+5:2350:x1876180397521664:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 26us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265311.985490:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 82 00000100:00100000:1.0:1789265311.985530:0:11857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397521920 00000100:00100000:1.0:1789265311.985539:0:11857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397521920 00000100:00100000:1.0:1789265311.985573:0:11857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 138 00000100:00100000:1.0:1789265311.985581:0:11857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1034afad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+6:2350:x1876180397521920:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789265311.985612:0:11857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1034afad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+6:2350:x1876180397521920:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 33us (435us total) trans 0 rc 0/0 00000100:00080000:0.0:1789265311.985993:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265311.985998:0:11857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 138 00000100:00080000:0.0:1789265311.986000:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789265311.986004:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:1.0:1789265311.986858:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789265311.986889:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789265311.986932:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789265311.986938:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789265311.987296:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397521536 00000100:00100000:2.0:1789265311.987304:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397521536 00000100:00100000:2.0:1789265311.987342:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 289 00000100:00100000:2.0:1789265311.987352:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1230cd-a81b-4bcc-a532-e24f5353fef4+13:2350:x1876180397521536:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789265311.987407:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1230cd-a81b-4bcc-a532-e24f5353fef4+13:2350:x1876180397521536:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 57us (2434us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265311.987415:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 289 00000100:00100000:0.0:1789265312.050475:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789265312.050509:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103bb05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414305280:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789265312.050578:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265312.050759:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414305280 00000100:00100000:3.0:1789265312.050767:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414305280 00000100:00100000:3.0:1789265312.050819:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789265312.050829:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103fb32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876180414305280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789265312.050864:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789265312.051450:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103fb32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876180414305280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 620us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265312.051458:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789265312.051883:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103bb05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414305280:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789265312.053265:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265313.076590:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265313.888001:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265313.888110:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397522048 00000100:00100000:3.0:1789265313.888120:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397522048 00000100:00100000:3.0:1789265313.888183:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 139 00000100:00100000:3.0:1789265313.888195:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103fb31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+14:11307:x1876180397522048:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:3.0:1789265313.888214:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265313.888232:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb9527fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99effaa expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265313.888293:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb952803 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265313.888309:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb952803 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265313.888332:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb952803 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265313.888347:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8200/0x27274ba5bb95280a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265313.888354:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8200/0x27274ba5bb95280a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265313.888360:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8200/0x27274ba5bb95280a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265313.888581:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb952803 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265313.888589:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb952803 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265313.888596:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb952803 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265313.888602:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fae9200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789265313.888607:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb952803 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265313.888615:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb952803 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265313.888752:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a101b706400) 00010000:00010000:3.0:1789265313.888755:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265313.888760:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb952803 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265313.888772:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb952803 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265313.888785:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8200/0x27274ba5bb95280a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265313.888791:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8200/0x27274ba5bb95280a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265313.888796:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8200/0x27274ba5bb95280a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265313.888801:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fae8200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789265313.888804:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8200/0x27274ba5bb95280a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265313.888810:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8200/0x27274ba5bb95280a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265313.888817:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8a1032d00d00) 00010000:00010000:3.0:1789265313.888820:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265313.888822:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8200/0x27274ba5bb95280a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265313.888828:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8200/0x27274ba5bb95280a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265313.888858:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb9527fc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99effaa expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265313.888879:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a101b706400) 00010000:00010000:3.0:1789265313.888882:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265313.888887:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb9527fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99effaa expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265313.888897:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fae8c00, rc 0) 00000100:00100000:3.0:1789265313.888958:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103fb31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+14:11307:x1876180397522048:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 766us (967us total) trans 0 rc 301/301 00000100:00100000:3.0:1789265313.888966:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 139 00000100:00080000:0.0:1789265313.889239:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265313.901116:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265313.901316:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397522304 00000100:00100000:3.0:1789265313.901325:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397522304 00000100:00100000:3.0:1789265313.901374:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 140 00000100:00100000:3.0:1789265313.901383:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1041b70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+14:11307:x1876180397522304:12345-192.168.203.37@tcp:36:lfs.0 00010000:00010000:3.0:1789265313.901436:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265313.901462:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017262c00/0x27274ba5bb95217a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efde3 expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265313.901492:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a101b706400) 00010000:00010000:3.0:1789265313.901496:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789265313.901759:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9400/0x27274ba5bb952811 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265313.901773:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb9527d2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff9c expref: 5 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265313.901782:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9400/0x27274ba5bb952811 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265313.901824:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb9527d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff9c expref: 5 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265313.902046:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb9527d2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff9c expref: 5 pid: 5841 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265313.902062:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103bb05180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876180414305408:192.168.203.37@tcp:104: 00000100:00100000:3.0:1789265313.902178:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a0f0294ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265313.905736:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265313.906669:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103bb05180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876180414305408:192.168.203.37@tcp:104: 00010000:00010000:1.0:1789265313.906699:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9400/0x27274ba5bb952811 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265313.910581:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397522432 00000100:00100000:2.0:1789265313.910598:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397522432 00010000:00010000:2.0:1789265313.911332:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb9527d2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff9c expref: 6 pid: 5841 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265313.911375:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 61 00000100:00100000:2.0:1789265313.911386:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bb05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+6:2351:x1876180397522432:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265313.911401:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265313.911408:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb9527d2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff9c expref: 6 pid: 5841 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265313.911424:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb9527d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff9c expref: 6 pid: 5841 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265313.911447:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb9527d2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff9c expref: 6 pid: 5841 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265313.911484:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a101b706400) 00010000:00010000:2.0:1789265313.911489:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9400/0x27274ba5bb952811 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265313.911498:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9400/0x27274ba5bb952811 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265313.911505:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9400/0x27274ba5bb952811 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265313.911530:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265313.911589:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bb05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+5:2351:x1876180397522432:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 205us (5861us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265313.911597:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 61 00010000:00010000:3.0:1789265313.912365:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9400/0x27274ba5bb952811 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265313.912377:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9400/0x27274ba5bb952811 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265313.912401:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb952818 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265313.912413:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb952818 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265313.912422:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb952818 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789265313.913317:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:3.0:1789265313.917731:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1789265313.917752:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9400/0x27274ba5bb952811 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265313.917765:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9400/0x27274ba5bb952811 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265313.917781:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9400/0x27274ba5bb952811 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265313.917787:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fae9400 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789265313.917792:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9400/0x27274ba5bb952811 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265313.917800:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9400/0x27274ba5bb952811 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265313.917818:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a101b706400) 00010000:00010000:3.0:1789265313.917821:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265313.917825:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9400/0x27274ba5bb952811 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265313.917830:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9400/0x27274ba5bb952811 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789265313.917851:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000141cd4ad reply state 000000008d167413 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb952818 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265313.918171:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789265313.918645:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1041b70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+15:11307:x1876180397522304:12345-192.168.203.37@tcp:36:lfs.0 Request processed in 17258us (17532us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1789265313.918656:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 140 00010000:00010000:0.0:1789265313.925225:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb952818 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265313.925242:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb952818 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265313.925250:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb952818 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265313.925268:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fae8c00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789265313.925273:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb952818 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265313.925281:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb952818 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265313.925298:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8a1032d00d00) 00010000:00010000:0.0:1789265313.925301:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265313.925305:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb952818 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265313.925311:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb952818 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265314.052772:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265314.052872:0:11857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397522560 00000100:00100000:2.0:1789265314.054329:0:11857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397522560 00000100:00100000:2.0:1789265314.054463:0:11857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 141 00000100:00100000:2.0:1789265314.054475:0:11857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bb05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+14:11315:x1876180397522560:12345-192.168.203.37@tcp:101:lctl.0 00010000:00010000:2.0:1789265314.054501:0:11857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265314.054524:0:11857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb95281f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99effb1 expref: -99 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.054590:0:11857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6400/0x27274ba5bb952826 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.054603:0:11857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6400/0x27274ba5bb952826 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.054614:0:11857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6400/0x27274ba5bb952826 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265314.054674:0:11857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789265314.054678:0:11857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789265314.054703:0:11857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6400/0x27274ba5bb952826 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.054727:0:11857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb95281f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99effb1 expref: 16 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.054745:0:11857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6400/0x27274ba5bb952826 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99effb1 expref: 15 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.054754:0:11857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1012931100) 00010000:00010000:2.0:1789265314.054757:0:11857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789265314.054761:0:11857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fad6400, rc 0) 00000100:00100000:2.0:1789265314.054880:0:11857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bb05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+15:11315:x1876180397522560:12345-192.168.203.37@tcp:101:lctl.0 Request processed in 400us (2109us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265314.054888:0:11857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 141 00010000:00010000:3.0:1789265314.105236:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789265314.162316:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000001:00080000:3.0:1789265314.162332:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967417 is committed 00000100:00100000:3.0:1789265314.191810:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265314.192006:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397522688 00000100:00100000:1.0:1789265314.192017:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397522688 00000100:00100000:1.0:1789265314.192118:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 142 00000100:00100000:1.0:1789265314.192129:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+13:11321:x1876180397522688:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:1.0:1789265314.192149:0:7934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265314.192169:0:7934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb95282d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99effb8 expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.192239:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb952834 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.192253:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb952834 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.192263:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb952834 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.192276:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596200/0x27274ba5bb95283b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.192282:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596200/0x27274ba5bb95283b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.192296:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596200/0x27274ba5bb95283b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.192822:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596400/0x27274ba5bb952842 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.192831:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596400/0x27274ba5bb952842 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.192838:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596400/0x27274ba5bb952842 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265314.192862:0:7934:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1789265314.192865:0:7934:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789265314.192882:0:7934:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596400/0x27274ba5bb952842 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.192956:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb952834 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.192963:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb952834 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.193019:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb952834 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.193034:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b597c00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789265314.193038:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb952834 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.193044:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb952834 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.193063:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1012931100) 00010000:00010000:1.0:1789265314.193066:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265314.193071:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb952834 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.193105:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb952834 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.193118:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596200/0x27274ba5bb95283b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.193123:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596200/0x27274ba5bb95283b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.193129:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596200/0x27274ba5bb95283b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.193133:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b596200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789265314.193135:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596200/0x27274ba5bb95283b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.193140:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596200/0x27274ba5bb95283b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.193147:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8a101cdf4d00) 00010000:00010000:1.0:1789265314.193149:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265314.193152:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596200/0x27274ba5bb95283b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.193157:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596200/0x27274ba5bb95283b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.193198:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb95282d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99effb8 expref: 15 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.193210:0:7934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596400/0x27274ba5bb952842 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99effb8 expref: 14 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.193217:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a101cdf4400) 00010000:00010000:1.0:1789265314.193219:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789265314.193221:0:7934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a101b596400, rc 0) 00000100:00100000:1.0:1789265314.193376:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+14:11321:x1876180397522688:12345-192.168.203.37@tcp:101:bash.0 Request processed in 1249us (1576us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265314.193385:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 142 00000100:00100000:0.0:1789265314.204710:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265314.205017:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397522944 00000100:00100000:3.0:1789265314.205037:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397522944 00000100:00100000:3.0:1789265314.205132:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 143 00000100:00100000:3.0:1789265314.205142:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103fb30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+14:11321:x1876180397522944:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:3.0:1789265314.205162:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265314.205180:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9400/0x27274ba5bb952849 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99effbf expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.205536:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb952850 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.205550:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb952850 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.205563:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb952850 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.205624:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb952857 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.205644:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb952857 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.205651:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb952857 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789265314.206370:0:5842:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1789265314.206628:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb95285e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.206640:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb95285e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.206647:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb95285e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.206680:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb952850 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.206687:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb952850 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.206693:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb952850 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.206699:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad6600 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789265314.206703:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb952850 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.206710:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb952850 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.206732:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a101cdf4400) 00010000:00010000:2.0:1789265314.206735:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265314.206739:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb952850 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.206745:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb952850 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789265314.206757:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000017fb90c1 reply state 000000004abed4e8 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb952857 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265314.206765:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789265314.206796:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9400/0x27274ba5bb952849 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99effbf expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.206808:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb95285e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99effbf expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.206814:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a1012931a00) 00010000:00010000:2.0:1789265314.206817:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789265314.206819:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fad7a00, rc 0) 00000100:00100000:2.0:1789265314.206892:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103fb30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+17:11321:x1876180397522944:12345-192.168.203.37@tcp:101:bash.0 Request processed in 1752us (2190us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1789265314.206901:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 143 00010000:00010000:0.0:1789265314.209114:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb952857 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265314.209131:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb952857 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265314.209138:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb952857 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265314.209143:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad6200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789265314.209148:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb952857 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265314.209155:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb952857 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265314.209185:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8a1012931600) 00010000:00010000:0.0:1789265314.209188:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265314.209192:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb952857 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265314.209199:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb952857 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265314.217897:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265314.217979:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397523072 00000100:00100000:2.0:1789265314.217999:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397523072 00000100:00100000:2.0:1789265314.218109:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 47 00000100:00100000:2.0:1789265314.218121:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103fb33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+5:2349:x1876180397523072:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:2.0:1789265314.218153:0:6684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265314.218174:0:6684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9c76720/0x27274ba5bb95286c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99effc6 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789265314.218201:0:6684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789265314.218219:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=360s v=(0 0) 00010000:00010000:2.0:1789265314.218224:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265314.218233:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9c76720/0x27274ba5bb95286c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99effc6 expref: 6 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.218253:0:6684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f9c76720/0x27274ba5bb95286c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99effc6 expref: 6 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.218267:0:6684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fad7e00, rc 0) 00000100:00100000:2.0:1789265314.218324:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103fb33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:2349:x1876180397523072:12345-192.168.203.37@tcp:101:bash.0 Request processed in 206us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265314.218332:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 47 00000100:00080000:1.0:1789265314.219277:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265314.229233:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265314.229335:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397523200 00000100:00100000:1.0:1789265314.229344:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397523200 00000100:00100000:1.0:1789265314.229397:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 48 00000100:00100000:1.0:1789265314.229406:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103f98e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:11321:x1876180397523200:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:1.0:1789265314.229421:0:8856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265314.229439:0:8856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f4ea0eb/0x27274ba5bb952873 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99effcd expref: -99 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.229468:0:8856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f9c76720/0x27274ba5bb95286c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99effc6 expref: 7 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.229476:0:8856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265314.229480:0:8856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265314.229497:0:8856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f4ea0eb/0x27274ba5bb952873 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99effcd expref: 7 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.229529:0:8856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f9c76720/0x27274ba5bb95286c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99effc6 expref: 7 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.229543:0:8856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f9c76720/0x27274ba5bb95286c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99effc6 expref: 7 pid: 6684 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265314.229555:0:8856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10031fd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8856:1876180414305536:192.168.203.37@tcp:104: 00000100:00100000:1.0:1789265314.229683:0:8856:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103cd50f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789265314.242285:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265314.243041:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397523328 00000100:00100000:2.0:1789265314.243053:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397523328 00010000:00010000:2.0:1789265314.243137:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f9c76720/0x27274ba5bb95286c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99effc6 expref: 8 pid: 6684 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265314.243180:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 62 00000100:00100000:2.0:1789265314.243191:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102efe1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+8:2350:x1876180397523328:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265314.243204:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265314.243236:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f9c76720/0x27274ba5bb95286c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99effc6 expref: 8 pid: 6684 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.243254:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f9c76720/0x27274ba5bb95286c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99effc6 expref: 8 pid: 6684 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.243279:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265314.243283:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265314.243290:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004f4ea0eb/0x27274ba5bb952873 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99effcd expref: 8 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.243299:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f4ea0eb/0x27274ba5bb952873 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99effcd expref: 8 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.243334:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000004f4ea0eb/0x27274ba5bb952873 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99effcd expref: 8 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265314.243348:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1041b72680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5825:1876180414305664:192.168.203.37@tcp:105: 00000100:00100000:2.0:1789265314.243422:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1020c49e40 going to sleep for 11 seconds 00010000:00010000:1.0:1789265314.247366:0:8856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9c76720/0x27274ba5bb95286c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99effc6 expref: 8 pid: 6684 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265314.247390:0:8856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10031fd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8856:1876180414305536:192.168.203.37@tcp:104: 00010000:00010000:1.0:1789265314.247421:0:8856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004f4ea0eb/0x27274ba5bb952873 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.37@tcp remote: 0x73b61075d99effcd expref: 7 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.247437:0:8856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a101b596600, rc 0) 00000100:00100000:1.0:1789265314.247502:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103f98e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+7:11321:x1876180397523200:12345-192.168.203.37@tcp:101:bash.0 Request processed in 18097us (18277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265314.247510:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 48 00000100:00100000:2.0:1789265314.252279:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1041b72680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5825:1876180414305664:192.168.203.37@tcp:105: 00010000:00010000:2.0:1789265314.252308:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265314.252373:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102efe1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:2350:x1876180397523328:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 9182us (10097us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265314.252384:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 62 00000100:00100000:0.0:1789265314.255352:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265314.255426:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397523584 00000100:00100000:1.0:1789265314.255436:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397523584 00000100:00100000:1.0:1789265314.255497:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 36 00000100:00100000:1.0:1789265314.255510:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102efe1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+16:11321:x1876180397523584:12345-192.168.203.37@tcp:35:bash.0 00000100:00100000:1.0:1789265314.255930:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102efe1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+17:11321:x1876180397523584:12345-192.168.203.37@tcp:35:bash.0 Request processed in 422us (585us total) trans 4294967419 rc 0/0 00000100:00100000:1.0:1789265314.255939:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 36 00000100:00100000:3.0:1789265314.362668:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265314.365640:0:11857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397523840 00000100:00100000:2.0:1789265314.365654:0:11857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397523840 00000100:00100000:2.0:1789265314.365747:0:11857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 144 00000100:00100000:2.0:1789265314.365758:0:11857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103f98c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+17:11331:x1876180397523840:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:2.0:1789265314.365783:0:11857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265314.365804:0:11857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb95287a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99effd4 expref: -99 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265314.365913:0:11857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1789265314.366052:0:11857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb95287a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99effd4 expref: 19 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.366066:0:11857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1012931100) 00010000:00010000:2.0:1789265314.366069:0:11857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789265314.366092:0:11857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb95287a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99effd4 expref: 19 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.366106:0:11857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fad6600, rc 0) 00000100:00100000:2.0:1789265314.366174:0:11857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103f98c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+18:11331:x1876180397523840:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 419us (3515us total) trans 4294967420 rc 301/301 00000100:00100000:2.0:1789265314.366180:0:11857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 144 00000100:00100000:2.0:1789265314.378115:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265314.378255:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397524096 00000100:00100000:1.0:1789265314.378266:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397524096 00000100:00100000:1.0:1789265314.378327:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 37 00000100:00100000:1.0:1789265314.378337:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1041b72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+18:11331:x1876180397524096:12345-192.168.203.37@tcp:35:lfs.0 00000100:00100000:1.0:1789265314.378552:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1041b72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+19:11331:x1876180397524096:12345-192.168.203.37@tcp:35:lfs.0 Request processed in 216us (484us total) trans 4294967421 rc 0/0 00000100:00100000:1.0:1789265314.378560:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 37 00000100:00100000:0.0:1789265314.472482:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265314.472996:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397524224 00000100:00100000:2.0:1789265314.473007:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397524224 00000100:00100000:2.0:1789265314.473123:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 145 00000100:00100000:2.0:1789265314.473134:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102efe3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+19:11337:x1876180397524224:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:2.0:1789265314.473158:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265314.473178:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb952888 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99effdb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.473275:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7e00/0x27274ba5bb95288f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.473289:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7e00/0x27274ba5bb95288f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.473535:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7e00/0x27274ba5bb95288f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265314.473570:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1789265314.473573:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789265314.473590:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7e00/0x27274ba5bb95288f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.473613:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb952888 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99effdb expref: 21 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.473629:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7e00/0x27274ba5bb95288f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99effdb expref: 20 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.473636:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a101cdf4400) 00010000:00010000:2.0:1789265314.473639:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789265314.473642:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fad7e00, rc 0) 00000100:00100000:2.0:1789265314.473794:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102efe3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+20:11337:x1876180397524224:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 661us (1321us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265314.473802:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 145 00000100:00100000:3.0:1789265314.479967:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265314.483544:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397524480 00000100:00100000:2.0:1789265314.483559:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397524480 00000100:00100000:2.0:1789265314.483723:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 146 00000100:00100000:2.0:1789265314.483736:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103f98dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+20:11337:x1876180397524480:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:2.0:1789265314.483755:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265314.483776:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb952896 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99effe2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.483871:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb95289d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.483884:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb95289d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.483906:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb95289d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265314.483916:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789265314.484045:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb952896 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99effe2 expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.484063:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb95289d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99effe2 expref: 22 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.484072:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a1012931a00) 00010000:00010000:2.0:1789265314.484116:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789265314.484119:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fad6200, rc 0) 00000100:00100000:2.0:1789265314.484183:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103f98dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+22:11337:x1876180397524480:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 450us (4225us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1789265314.484189:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 146 00000100:00100000:0.0:1789265314.491849:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265314.492017:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397524608 00000100:00100000:2.0:1789265314.492047:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397524608 00000100:00100000:2.0:1789265314.492122:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 11 00000100:00100000:2.0:1789265314.492134:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102efe3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+22:2351:x1876180397524608:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265314.492148:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265314.492171:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb95289d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99effe2 expref: 22 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.492188:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a1012931a00) 00010000:00010000:2.0:1789265314.492192:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265314.492248:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102efe3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+21:2351:x1876180397524608:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 117us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265314.492256:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 11 00000100:00100000:3.0:1789265314.495324:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265314.503917:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397524864 00000100:00100000:1.0:1789265314.503932:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397524864 00000100:00100000:1.0:1789265314.504004:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 147 00000100:00100000:1.0:1789265314.504014:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103f98df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+21:11337:x1876180397524864:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:1.0:1789265314.504203:0:7934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265314.504226:0:7934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596200/0x27274ba5bb9528ab lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99effe9 expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.504319:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb9528b2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.504333:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb9528b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.504344:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb9528b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265314.504469:0:7934:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789265314.504599:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596200/0x27274ba5bb9528ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99effe9 expref: 24 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.504617:0:7934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb9528b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99effe9 expref: 23 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.504625:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a1012931a00) 00010000:00010000:1.0:1789265314.504628:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789265314.504631:0:7934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a101b597c00, rc 0) 00000100:00100000:1.0:1789265314.504693:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103f98df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+23:11337:x1876180397524864:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 681us (9378us total) trans 4294967423 rc 0/0 00000100:00100000:1.0:1789265314.504701:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 147 00000100:00100000:0.0:1789265314.516643:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265314.516744:0:12007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397524992 00000100:00100000:3.0:1789265314.516756:0:12007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397524992 00000100:00100000:3.0:1789265314.516814:0:12007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 49 00000100:00100000:3.0:1789265314.516823:0:12007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102efe2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:2349:x1876180397524992:12345-192.168.203.37@tcp:1:lfs.0 00010000:00010000:3.0:1789265314.516861:0:12007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ad405c4/0x27274ba5bb9528c0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.516880:0:12007:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004f4ea0eb/0x27274ba5bb952873 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.37@tcp remote: 0x73b61075d99effcd expref: 6 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.516888:0:12007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265314.516892:0:12007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789265314.516896:0:12007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ad405c4/0x27274ba5bb9528c0 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.516944:0:12007:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004f4ea0eb/0x27274ba5bb952873 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.37@tcp remote: 0x73b61075d99effcd expref: 6 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.516960:0:12007:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004f4ea0eb/0x27274ba5bb952873 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.37@tcp remote: 0x73b61075d99effcd expref: 6 pid: 8856 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265314.516975:0:12007:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103f98ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12007:1876180414305792:192.168.203.37@tcp:104: 00000100:00100000:3.0:1789265314.517784:0:12007:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a0f0294cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789265314.521692:0:12007:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103f98ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12007:1876180414305792:192.168.203.37@tcp:104: 00010000:00010000:3.0:1789265314.521726:0:12007:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009ad405c4/0x27274ba5bb9528c0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265314.523213:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265314.523300:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397525120 00000100:00100000:1.0:1789265314.523310:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397525120 00002000:00100000:1.0:1789265314.523355:0:6690:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8a102efe2d80 x1876180397525120/t0(0) o4->4b820fcb-1bab-4b78-bfa4-355c22a09cf8@192.168.203.37@tcp:640/0 lens 504/0 e 0 to 0 dl 1789265325 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789265314.523367:0:6690:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a102efe2d80 with x1876180397525120 ext(0->12) 00010000:00010000:1.0:1789265314.523376:0:6690:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000004f4ea0eb/0x27274ba5bb952873 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.37@tcp remote: 0x73b61075d99effcd expref: 7 pid: 8856 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.523394:0:6690:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000004f4ea0eb/0x27274ba5bb952873 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.37@tcp remote: 0x73b61075d99effcd expref: 7 pid: 8856 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789265314.523402:0:6690:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8a102efe2d80 00000100:00100000:1.0:1789265314.523430:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 2 00000100:00100000:1.0:1789265314.523438:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102efe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+7:2350:x1876180397525120:12345-192.168.203.37@tcp:4:lfs.0 00000100:00100000:1.0:1789265314.523899:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102efe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+9:2350:x1876180397525120:12345-192.168.203.37@tcp:4:lfs.0 Request processed in 459us (690us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1789265314.523911:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 2 00002000:00100000:1.0:1789265314.523919:0:6690:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8a102efe2d80 x1876180397525120/t4294967305(0) o4->4b820fcb-1bab-4b78-bfa4-355c22a09cf8@192.168.203.37@tcp:640/0 lens 504/448 e 0 to 0 dl 1789265325 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789265314.523929:0:6690:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a102efe2d80 with x1876180397525120 ext(0->12) 00010000:00010000:1.0:1789265314.523934:0:6690:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000004f4ea0eb/0x27274ba5bb952873 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.37@tcp remote: 0x73b61075d99effcd expref: 9 pid: 8856 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.523947:0:6690:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000004f4ea0eb/0x27274ba5bb952873 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.37@tcp remote: 0x73b61075d99effcd expref: 9 pid: 8856 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789265314.523954:0:6690:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8a102efe2d80 00000100:00100000:0.0:1789265314.529819:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265314.530033:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397525248 00000100:00100000:3.0:1789265314.530044:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397525248 00010000:00010000:3.0:1789265314.530116:0:8490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004f4ea0eb/0x27274ba5bb952873 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.37@tcp remote: 0x73b61075d99effcd expref: 9 pid: 8856 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265314.530156:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 63 00000100:00100000:3.0:1789265314.530165:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102efe3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+9:2351:x1876180397525248:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265314.530182:0:8490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789265314.530203:0:8490:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789265314.530206:0:8490:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789265314 00002000:00010000:3.0:1789265314.530208:0:8490:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789265314 00002000:00010000:3.0:1789265314.530211:0:8490:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1789265314 00010000:00010000:3.0:1789265314.530230:0:8490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004f4ea0eb/0x27274ba5bb952873 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.37@tcp remote: 0x73b61075d99effcd expref: 9 pid: 8856 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.530260:0:8490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004f4ea0eb/0x27274ba5bb952873 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.37@tcp remote: 0x73b61075d99effcd expref: 9 pid: 8856 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.530286:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f4ea0eb/0x27274ba5bb952873 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.37@tcp remote: 0x73b61075d99effcd expref: 9 pid: 8856 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.530302:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789265314.530306:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789265314.530312:0:8490:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009ad405c4/0x27274ba5bb9528c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.530321:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ad405c4/0x27274ba5bb9528c0 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.530368:0:8490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265314.530430:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102efe3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+8:2351:x1876180397525248:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 265us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265314.530437:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 63 00010000:00010000:0.0:1789265314.530886:0:12007:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009ad405c4/0x27274ba5bb9528c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265314.530896:0:12007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ad405c4/0x27274ba5bb9528c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265314.530922:0:12007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ad405c4/0x27274ba5bb9528c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265314.530931:0:12007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ad405c4/0x27274ba5bb9528c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265314.530953:0:12007:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ad405c4/0x27274ba5bb9528c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265314.530959:0:12007:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fae8200 already unused, calling callback (ffffffffc1581350) 00010000:00010000:0.0:1789265314.530963:0:12007:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ad405c4/0x27274ba5bb9528c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265314.530972:0:12007:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ad405c4/0x27274ba5bb9528c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265314.530985:0:12007:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ad405c4/0x27274ba5bb9528c0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265314.530992:0:12007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ad405c4/0x27274ba5bb9528c0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265314.531068:0:12007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102efe2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+7:2349:x1876180397524992:12345-192.168.203.37@tcp:1:lfs.0 Request processed in 14245us (14433us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265314.531118:0:12007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 49 00000100:00100000:0.0:1789265314.534899:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265314.535005:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397525504 00000100:00100000:1.0:1789265314.535015:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397525504 00000100:00100000:1.0:1789265314.535102:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 38 00000100:00100000:1.0:1789265314.535113:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1010a42850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+23:11337:x1876180397525504:12345-192.168.203.37@tcp:35:lfs.0 00000004:00010000:1.0:1789265314.535178:0:5843:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb9528b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99effe9 expref: 23 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789265314.535824:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:1.0:1789265314.535875:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:1.0:1789265314.537905:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00010000:00010000:1.0:1789265314.537998:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb9528c7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.538019:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb95285e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99effbf expref: 27 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.538052:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb9528c7 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.538679:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb95285e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99effbf expref: 27 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.538700:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb95285e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99effbf expref: 27 pid: 5842 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265314.538716:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10031fd880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5843:1876180414305920:192.168.203.37@tcp:104: 00000100:00100000:1.0:1789265314.538805:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10107f2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789265314.544540:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10031fd880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5843:1876180414305920:192.168.203.37@tcp:104: 00000100:00100000:2.0:1789265314.544553:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00010000:00010000:0.0:1789265314.544577:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb9528c7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265314.544809:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397525632 00000100:00100000:3.0:1789265314.544817:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397525632 00010000:00010000:3.0:1789265314.544923:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb95285e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99effbf expref: 28 pid: 5842 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265314.544964:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 64 00000100:00100000:3.0:1789265314.544974:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10118e6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+28:2350:x1876180397525632:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265314.545002:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265314.545009:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb95285e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99effbf expref: 28 pid: 5842 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.545300:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb95285e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99effbf expref: 28 pid: 5842 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.545326:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb95285e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99effbf expref: 28 pid: 5842 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.545340:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a1012931a00) 00010000:00010000:3.0:1789265314.545355:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb9528c7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.545363:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb9528c7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.545370:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb9528c7 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265314.549777:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789265314.549857:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb9528c7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.549871:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb9528c7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265314.549993:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10118e6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+27:2350:x1876180397525632:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 5015us (5438us total) trans 0 rc 0/0 00000001:00080000:2.0:1789265314.550001:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:0.0:1789265314.550006:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 64 00000001:00080000:2.0:1789265314.550250:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1789265314.550522:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1041b70700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5843:1876180414306048:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789265314.550585:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265314.550624:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1032d38000 going to sleep for 11 seconds 00000100:00100000:0.0:1789265314.551263:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414306048 00000100:00100000:0.0:1789265314.551273:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414306048 00000100:00100000:0.0:1789265314.551337:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789265314.551355:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1041b73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5843:x1876180414306048:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789265314.551463:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1041b73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5843:x1876180414306048:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 110us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265314.551470:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789265314.551604:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1041b70700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5843:1876180414306048:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789265314.552191:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:3.0:1789265314.552261:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103f98ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5843:1876180414306176:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789265314.552305:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265314.552430:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a0f0294c780 going to sleep for 11 seconds 00000100:00100000:0.0:1789265314.552800:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414306176 00000100:00100000:0.0:1789265314.552809:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414306176 00000100:00100000:0.0:1789265314.552842:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789265314.552849:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103f98fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5843:x1876180414306176:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789265314.553053:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103f98fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5843:x1876180414306176:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 203us (747us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789265314.553060:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1789265314.553190:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265314.554628:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103f98ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5843:1876180414306176:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789265314.554728:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:3.0:1789265314.554803:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb9528c7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.554815:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb9528c7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.554822:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb9528c7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.554829:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b597200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789265314.554833:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb9528c7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.554841:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb9528c7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.554857:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a1012931a00) 00010000:00010000:3.0:1789265314.554861:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789265314.554865:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb9528c7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.554871:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb9528c7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789265314.555104:0:5843:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789265314.557687:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:3.0:1789265314.557711:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 360362635394ns, next at 361362631173ns, rc = 0 00000001:00080000:3.0:1789265314.557728:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:3.0:1789265314.557790:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a1012931a00) 00010000:00010000:3.0:1789265314.557794:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789265314.557805:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb9528b2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99effe9 expref: 31 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265314.557940:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1010a42850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+30:11337:x1876180397525504:12345-192.168.203.37@tcp:35:lfs.0 Request processed in 22827us (23048us total) trans 4294967432 rc 0/0 00000100:00100000:3.0:1789265314.557949:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 38 00000020:00080000:3.0:1789265314.557956:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789265314.562449:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265314.562616:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397525760 00000100:00100000:3.0:1789265314.562626:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397525760 00000100:00100000:3.0:1789265314.562686:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 148 00000100:00100000:3.0:1789265314.562697:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1041b71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+30:11337:x1876180397525760:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:3.0:1789265314.562722:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265314.562745:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb9528ce lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99efff0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.562803:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb9528ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efff0 expref: 31 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.562817:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb9528ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efff0 expref: 31 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.562837:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a1032d00600) 00010000:00010000:3.0:1789265314.562840:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789265314.562844:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fae9200, rc 0) 00000100:00100000:3.0:1789265314.562906:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1041b71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+31:11337:x1876180397525760:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 211us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265314.562913:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 148 00000100:00100000:0.0:1789265314.567829:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265314.572666:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397526016 00000100:00100000:3.0:1789265314.572681:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397526016 00000100:00100000:3.0:1789265314.572761:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 39 00000100:00100000:3.0:1789265314.572771:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102efe1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+31:11337:x1876180397526016:12345-192.168.203.37@tcp:35:lfs.0 00000100:00100000:1.0:1789265314.573669:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102efe1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+32:11337:x1876180397526016:12345-192.168.203.37@tcp:35:lfs.0 Request processed in 894us (5845us total) trans 4294967433 rc 0/0 00000100:00100000:1.0:1789265314.573679:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 39 00000100:00100000:1.0:1789265314.700172:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265314.701133:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397526272 00000100:00100000:2.0:1789265314.701145:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397526272 00000100:00100000:2.0:1789265314.701222:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 149 00000100:00100000:2.0:1789265314.701233:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10031fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+32:11347:x1876180397526272:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:2.0:1789265314.701274:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265314.701297:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb9528d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99efff7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265314.701607:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1789265314.701723:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb9528d5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efff7 expref: 34 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.701739:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1012931100) 00010000:00010000:2.0:1789265314.701743:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789265314.701748:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb9528d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efff7 expref: 34 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.701763:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fad7400, rc 0) 00000100:00100000:2.0:1789265314.701822:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10031fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+33:11347:x1876180397526272:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 591us (1671us total) trans 4294967434 rc 301/301 00000100:00100000:2.0:1789265314.701830:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 149 00000100:00100000:2.0:1789265314.705444:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265314.705636:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397526400 00000100:00100000:3.0:1789265314.705646:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397526400 00000100:00100000:3.0:1789265314.705705:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 150 00000100:00100000:3.0:1789265314.705715:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1041b73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+33:11347:x1876180397526400:12345-192.168.203.37@tcp:34:lfs.0 00010000:00010000:3.0:1789265314.705792:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb9528e3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.705807:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb9528e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.705818:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb9528e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.705835:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8400/0x27274ba5bb9528ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.705841:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8400/0x27274ba5bb9528ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.705848:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8400/0x27274ba5bb9528ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.705949:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb9528f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.705957:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb9528f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.705964:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb9528f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789265314.706026:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb9528f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.706040:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb9528e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.706046:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb9528e3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.706053:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb9528e3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.706060:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fae9a00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789265314.706063:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb9528e3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.706070:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb9528e3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.706125:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a101cdf4400) 00010000:00010000:3.0:1789265314.706128:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265314.706132:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb9528e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.706137:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb9528e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.706150:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8400/0x27274ba5bb9528ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.706156:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8400/0x27274ba5bb9528ea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.706179:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8400/0x27274ba5bb9528ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.706184:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fae8400 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789265314.706187:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8400/0x27274ba5bb9528ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.706193:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8400/0x27274ba5bb9528ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.706201:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8a1032d00100) 00010000:00010000:3.0:1789265314.706204:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265314.706206:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8400/0x27274ba5bb9528ea lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.706212:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8400/0x27274ba5bb9528ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.706226:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb9528f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.706232:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb9528f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.706238:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb9528f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.706243:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fae8e00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789265314.706245:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb9528f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.706261:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb9528f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.706270:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a1032d00600) 00010000:00010000:3.0:1789265314.706272:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265314.706275:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb9528f1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265314.706281:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb9528f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265314.706508:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1041b73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+33:11347:x1876180397526400:12345-192.168.203.37@tcp:34:lfs.0 Request processed in 633us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265314.706519:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 150 00000100:00100000:0.0:1789265314.710734:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265314.710829:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397526656 00000100:00100000:2.0:1789265314.710840:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397526656 00000100:00100000:2.0:1789265314.710907:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 40 00000100:00100000:2.0:1789265314.710918:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102efe3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+33:11347:x1876180397526656:12345-192.168.203.37@tcp:35:lfs.0 00000100:00100000:2.0:1789265314.711987:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102efe3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+34:11347:x1876180397526656:12345-192.168.203.37@tcp:35:lfs.0 Request processed in 1064us (1255us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1789265314.711999:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 40 00000100:00100000:1.0:1789265314.780370:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265314.780647:0:11857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397526912 00000100:00100000:2.0:1789265314.780670:0:11857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397526912 00000100:00100000:2.0:1789265314.780733:0:11857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 151 00000100:00100000:2.0:1789265314.780743:0:11857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10037b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+34:11350:x1876180397526912:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:2.0:1789265314.780767:0:11857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265314.780787:0:11857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb9528f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99efffe expref: -99 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.780859:0:11857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb9528ff lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.780874:0:11857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb9528ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.780883:0:11857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb9528ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.780896:0:11857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952906 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.780902:0:11857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952906 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.780907:0:11857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952906 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.781035:0:11857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb95290d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.781044:0:11857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb95290d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.781051:0:11857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb95290d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265314.781072:0:11857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789265314.781220:0:11857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb9528ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.781227:0:11857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb9528ff lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.781234:0:11857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb9528ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.781240:0:11857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad7000 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789265314.781244:0:11857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb9528ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.781251:0:11857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb9528ff lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.781263:0:11857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a101cdf4400) 00010000:00010000:2.0:1789265314.781266:0:11857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265314.781271:0:11857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb9528ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.781277:0:11857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb9528ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.781290:0:11857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952906 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.781295:0:11857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952906 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.781311:0:11857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952906 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.781316:0:11857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad6000 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789265314.781319:0:11857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952906 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.781325:0:11857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952906 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.781334:0:11857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8a1012931b00) 00010000:00010000:2.0:1789265314.781336:0:11857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265314.781339:0:11857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952906 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.781345:0:11857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952906 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.781567:0:11857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb9528f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efffe expref: 37 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.781582:0:11857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb95290d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efffe expref: 36 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265314.781590:0:11857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a1032d00600) 00010000:00010000:2.0:1789265314.781592:0:11857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789265314.781595:0:11857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fad6c00, rc 0) 00000100:00100000:2.0:1789265314.781645:0:11857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10037b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+36:11350:x1876180397526912:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 904us (1294us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1789265314.781660:0:11857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 151 00000100:00100000:3.0:1789265314.786427:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265314.787685:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397527040 00000100:00100000:1.0:1789265314.787703:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397527040 00000100:00100000:1.0:1789265314.787851:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 152 00000100:00100000:1.0:1789265314.787864:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103f98d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+36:11350:x1876180397527040:12345-192.168.203.37@tcp:54:lfs.0 00010000:00010000:1.0:1789265314.787974:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb95291b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.788009:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb95291b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.788057:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb95291b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.788118:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb95291b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.788126:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb95291b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.788135:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb95291b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.788142:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b597a00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789265314.788147:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb95291b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.788155:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb95291b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.788178:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a1032d00600) 00010000:00010000:1.0:1789265314.788183:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789265314.788189:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb95291b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265314.788195:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb95291b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265314.788312:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103f98d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+36:11350:x1876180397527040:12345-192.168.203.37@tcp:54:lfs.0 Request processed in 449us (1899us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265314.788320:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 152 00000100:00100000:0.0:1789265314.791352:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265314.791542:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397527296 00000100:00100000:2.0:1789265314.791558:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397527296 00000100:00100000:2.0:1789265314.791664:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 41 00000100:00100000:2.0:1789265314.791677:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102efe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+36:11350:x1876180397527296:12345-192.168.203.37@tcp:35:lfs.0 00000100:00100000:2.0:1789265314.792031:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102efe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+37:11350:x1876180397527296:12345-192.168.203.37@tcp:35:lfs.0 Request processed in 347us (683us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1789265314.792039:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 41 00000100:00100000:0.0:1789265315.099481:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265315.101123:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397527552 00000100:00100000:3.0:1789265315.101137:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397527552 00000100:00100000:3.0:1789265315.101283:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 153 00000100:00100000:3.0:1789265315.101308:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102efe1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+37:11381:x1876180397527552:12345-192.168.203.37@tcp:101:cat.0 00010000:00010000:3.0:1789265315.101333:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265315.101354:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb952922 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f0005 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265315.101452:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb952929 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265315.101469:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb952929 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265315.101500:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb952929 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265315.101514:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00000100:00080000:1.0:1789265315.102663:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789265315.103418:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb952922 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0005 expref: 40 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265315.103448:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb952929 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0005 expref: 39 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265315.103458:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a1032d00600) 00010000:00010000:3.0:1789265315.103461:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789265315.103465:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fae8e00, rc 0) 00000100:00100000:3.0:1789265315.103714:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102efe1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+39:11381:x1876180397527552:12345-192.168.203.37@tcp:101:cat.0 Request processed in 2420us (4242us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1789265315.103732:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 153 00000100:00100000:2.0:1789265315.109170:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265315.109626:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265315.113470:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397527808 00000100:00100000:1.0:1789265315.113493:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397527808 00000100:00100000:1.0:1789265315.113600:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 42 00000100:00100000:1.0:1789265315.113613:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1041b73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+39:11381:x1876180397527808:12345-192.168.203.37@tcp:35:cat.0 00000100:00100000:1.0:1789265315.113976:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1041b73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+40:11381:x1876180397527808:12345-192.168.203.37@tcp:35:cat.0 Request processed in 363us (4819us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1789265315.113994:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 42 00000100:00100000:3.0:1789265315.120608:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397527936 00000100:00100000:3.0:1789265315.121064:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397527936 00000100:00100000:3.0:1789265315.121515:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 12 00000100:00100000:3.0:1789265315.121531:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1041b72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+40:2349:x1876180397527936:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265315.121554:0:8490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265315.121588:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb952929 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0005 expref: 40 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265315.121624:0:8490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a1032d00600) 00010000:00010000:3.0:1789265315.121631:0:8490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265315.121739:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1041b72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+39:2349:x1876180397527936:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 212us (12112us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265315.121748:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 12 00010000:00010000:0.0:1789265315.136036:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265315.193981:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265315.194117:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397528192 00000100:00100000:1.0:1789265315.194134:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397528192 00000100:00100000:1.0:1789265315.194223:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 154 00000100:00100000:1.0:1789265315.194237:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102efe0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+39:11387:x1876180397528192:12345-192.168.203.37@tcp:101:dd.0 00010000:00010000:1.0:1789265315.194273:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265315.194278:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789265315.194317:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7e00/0x27274ba5bb95288f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99effdb expref: 39 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265315.194339:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a101cdf4400) 00010000:00010000:1.0:1789265315.194345:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789265315.194363:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb952937 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f000c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265315.194495:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb95293e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265315.194511:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb95290d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efffe expref: 39 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265315.194521:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb95293e lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265315.194576:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb95290d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efffe expref: 39 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265315.194594:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb95290d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efffe expref: 39 pid: 11857 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265315.194608:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10037b3100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876180414306304:192.168.203.37@tcp:104: 00000100:00100000:1.0:1789265315.194972:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10107f2840 going to sleep for 11 seconds 00000100:00100000:1.0:1789265315.202042:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10037b3100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876180414306304:192.168.203.37@tcp:104: 00010000:00010000:1.0:1789265315.202131:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb95293e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265315.204056:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265315.204608:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397528320 00000100:00100000:2.0:1789265315.204621:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397528320 00010000:00010000:2.0:1789265315.204677:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb95290d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efffe expref: 40 pid: 11857 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265315.204727:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 65 00000100:00100000:2.0:1789265315.204740:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102efe2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+40:2351:x1876180397528320:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265315.204758:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265315.204765:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb95290d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efffe expref: 40 pid: 11857 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265315.204783:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb95290d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efffe expref: 40 pid: 11857 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265315.204812:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb95290d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99efffe expref: 40 pid: 11857 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265315.204853:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a1032d00600) 00010000:00010000:2.0:1789265315.204859:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb95293e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265315.204871:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb95293e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265315.204879:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb95293e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265315.204923:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265315.205056:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102efe2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+39:2351:x1876180397528320:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 319us (1010us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265315.205065:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 65 00010000:00010000:1.0:1789265315.205245:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb95293e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265315.205255:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb95293e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265315.205280:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789265315.205505:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb952937 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f000c expref: 40 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265315.205525:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb95293e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f000c expref: 39 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265315.205534:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a1032d00600) 00010000:00010000:1.0:1789265315.205537:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789265315.205549:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a101b597800, rc 0) 00000100:00100000:1.0:1789265315.205585:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102efe0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+39:11387:x1876180397528192:12345-192.168.203.37@tcp:101:dd.0 Request processed in 11352us (11622us total) trans 4294967440 rc 0/0 00000100:00100000:1.0:1789265315.205593:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 154 00000100:00100000:3.0:1789265315.211999:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265315.212115:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397528576 00000100:00100000:1.0:1789265315.214496:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397528576 00000100:00100000:1.0:1789265315.214618:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 155 00000100:00100000:1.0:1789265315.214633:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103f98f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+39:11387:x1876180397528576:12345-192.168.203.37@tcp:36:dd.0 00010000:00010000:1.0:1789265315.215039:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596e00/0x27274ba5bb95294c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265315.215062:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596e00/0x27274ba5bb95294c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265315.215107:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596e00/0x27274ba5bb95294c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789265315.215182:0:7934:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967441 00000004:00010000:1.0:1789265315.215211:0:7934:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000838ac2af reply state 00000000933b6fae transno 4294967442 ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596e00/0x27274ba5bb95294c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265315.215221:0:7934:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789265315.215344:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103f98f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+42:11387:x1876180397528576:12345-192.168.203.37@tcp:36:dd.0 Request processed in 713us (3366us total) trans 4294967442 rc 0/0 00000100:00100000:1.0:1789265315.215352:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 155 00000020:00080000:1.0:1789265315.215357:0:7934:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789265315.218381:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596e00/0x27274ba5bb95294c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265315.218404:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596e00/0x27274ba5bb95294c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265315.218413:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596e00/0x27274ba5bb95294c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265315.218419:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b596e00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789265315.218425:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596e00/0x27274ba5bb95294c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265315.218434:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596e00/0x27274ba5bb95294c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265315.218455:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a1032d00600) 00010000:00010000:3.0:1789265315.218458:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265315.218464:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596e00/0x27274ba5bb95294c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265315.218470:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596e00/0x27274ba5bb95294c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789265315.634403:0:6875:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 361439324635ns, next at 362439321313ns, rc = 0 00000100:00100000:2.0:1789265315.634488:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789265315.634517:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1034af9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414306432:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789265315.634627:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265315.635010:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414306432 00000100:00100000:3.0:1789265315.635033:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414306432 00000100:00100000:3.0:1789265315.635136:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789265315.635169:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1041b70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1876180414306432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789265315.635202:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789265315.635280:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1041b70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1876180414306432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265315.635288:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789265315.635395:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1034af9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414306432:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789265315.668326:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265315.668667:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397528704 00000100:00100000:0.0:1789265315.668685:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397528704 00000100:00100000:0.0:1789265315.668810:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 156 00000100:00100000:0.0:1789265315.668826:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1034af9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+41:11401:x1876180397528704:12345-192.168.203.37@tcp:101:stat.0 00010000:00010000:0.0:1789265315.668860:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265315.668887:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34000/0x27274ba5bb952953 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f0013 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265315.668982:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35e00/0x27274ba5bb95295a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265315.669001:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35e00/0x27274ba5bb95295a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265315.669024:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35e00/0x27274ba5bb95295a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265315.669042:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34400/0x27274ba5bb952961 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265315.669050:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34400/0x27274ba5bb952961 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265315.669057:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34400/0x27274ba5bb952961 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265315.669290:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35400/0x27274ba5bb952968 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265315.669302:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb95293e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f000c expref: 42 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265315.669310:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35400/0x27274ba5bb952968 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265315.669359:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb95293e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f000c expref: 42 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265315.669376:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb95293e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f000c expref: 42 pid: 5842 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265315.669391:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102efe1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1876180414306560:192.168.203.37@tcp:104: 00000100:00100000:0.0:1789265315.669582:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a0f01c9e240 going to sleep for 11 seconds 00000100:00100000:0.0:1789265315.673629:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265315.673805:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397528960 00000100:00100000:2.0:1789265315.673820:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397528960 00000100:00100000:2.0:1789265315.673908:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 43 00000100:00100000:2.0:1789265315.673921:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102efe0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+43:9216:x1876180397528960:12345-192.168.203.37@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789265315.674437:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102efe0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+44:9216:x1876180397528960:12345-192.168.203.37@tcp:35:ldlm_bl.0 Request processed in 517us (830us total) trans 4294967443 rc 0/0 00000100:00100000:2.0:1789265315.674445:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 43 00000100:00100000:3.0:1789265315.676552:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102efe1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1876180414306560:192.168.203.37@tcp:104: 00010000:00010000:3.0:1789265315.676597:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35400/0x27274ba5bb952968 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265315.696716:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265315.698438:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397529088 00000100:00100000:2.0:1789265315.698461:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397529088 00010000:00010000:2.0:1789265315.698541:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb95293e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f000c expref: 44 pid: 5842 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265315.698637:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 66 00000100:00100000:2.0:1789265315.698651:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10037b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+44:2349:x1876180397529088:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265315.698674:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265315.698683:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb95293e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f000c expref: 44 pid: 5842 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265315.698702:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb95293e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f000c expref: 44 pid: 5842 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265315.698737:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb95293e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f000c expref: 44 pid: 5842 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265315.698755:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a1032d00600) 00010000:00010000:2.0:1789265315.698762:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35400/0x27274ba5bb952968 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265315.698773:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35400/0x27274ba5bb952968 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265315.698792:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35400/0x27274ba5bb952968 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265315.698840:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789265315.699365:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35400/0x27274ba5bb952968 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265315.699378:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35400/0x27274ba5bb952968 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265315.699438:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789265315.699452:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789265315.699487:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35400/0x27274ba5bb952968 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265315.699504:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35400/0x27274ba5bb952968 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265315.699515:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35e00/0x27274ba5bb95295a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265315.699521:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35e00/0x27274ba5bb95295a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265315.699528:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35e00/0x27274ba5bb95295a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265315.699542:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10037b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+43:2349:x1876180397529088:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 891us (2840us total) trans 0 rc 0/0 00010000:00010000:0.0:1789265315.699547:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fa35e00 already unused, calling callback (ffffffffc1fc54f0) 00000100:00100000:2.0:1789265315.699551:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 66 00010000:00010000:0.0:1789265315.699553:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35e00/0x27274ba5bb95295a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265315.699560:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35e00/0x27274ba5bb95295a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265315.699573:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a101cdf4400) 00010000:00010000:0.0:1789265315.699576:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265315.699580:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35e00/0x27274ba5bb95295a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265315.699587:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35e00/0x27274ba5bb95295a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265315.699603:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34400/0x27274ba5bb952961 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265315.699881:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34400/0x27274ba5bb952961 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265315.699889:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34400/0x27274ba5bb952961 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265315.699894:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fa34400 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789265315.699897:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34400/0x27274ba5bb952961 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265315.699904:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34400/0x27274ba5bb952961 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265315.699926:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8a1002ca3d00) 00010000:00010000:0.0:1789265315.699929:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265315.699932:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34400/0x27274ba5bb952961 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265315.699939:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34400/0x27274ba5bb952961 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265315.700055:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34000/0x27274ba5bb952953 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0013 expref: 43 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265315.700100:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35400/0x27274ba5bb952968 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0013 expref: 42 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265315.700108:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a1032d00600) 00010000:00010000:0.0:1789265315.700111:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789265315.700113:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fa35400, rc 0) 00000100:00100000:0.0:1789265315.700173:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1034af9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+42:11401:x1876180397528704:12345-192.168.203.37@tcp:101:stat.0 Request processed in 31352us (31868us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265315.700182:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 156 00000100:00100000:1.0:1789265315.798057:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265315.798231:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397529344 00000100:00100000:2.0:1789265315.798264:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397529344 00000100:00100000:2.0:1789265315.798343:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 157 00000100:00100000:2.0:1789265315.798356:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c07bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+42:11407:x1876180397529344:12345-192.168.203.37@tcp:36:truncate.0 00010000:00010000:2.0:1789265315.798435:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265315.798480:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35400/0x27274ba5bb952968 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0013 expref: 42 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265315.798504:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a1032d00600) 00010000:00010000:2.0:1789265315.798510:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789265315.798805:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb95296f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265315.798822:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb95296f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265315.798834:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb95296f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789265315.798895:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967444 00000004:00010000:2.0:1789265315.798923:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006cad07f6 reply state 0000000092453299 transno 4294967445 ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb95296f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265315.798933:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789265315.799156:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c07bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+44:11407:x1876180397529344:12345-192.168.203.37@tcp:36:truncate.0 Request processed in 723us (1035us total) trans 4294967445 rc 0/0 00000100:00100000:2.0:1789265315.799164:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 157 00000020:00080000:2.0:1789265315.799170:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789265315.805985:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb95296f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265315.806010:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb95296f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265315.806030:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb95296f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265315.806060:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad7000 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789265315.806066:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb95296f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265315.806122:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb95296f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265315.806146:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a1032d00600) 00010000:00010000:0.0:1789265315.806150:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265315.806156:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb95296f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265315.806163:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb95296f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265315.934871:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265315.935025:0:11857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397529472 00000100:00100000:2.0:1789265315.935039:0:11857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397529472 00000100:00100000:2.0:1789265315.935160:0:11857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 158 00000100:00100000:2.0:1789265315.935192:0:11857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c07a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+43:11421:x1876180397529472:12345-192.168.203.37@tcp:101:stat.0 00010000:00010000:2.0:1789265315.935224:0:11857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265315.935251:0:11857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952976 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f001a expref: -99 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265315.935336:0:11857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb95297d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265315.935355:0:11857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb95297d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265315.935369:0:11857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb95297d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265315.935386:0:11857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952984 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265315.935394:0:11857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952984 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265315.935401:0:11857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952984 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265315.935512:0:11857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb95298b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265315.935521:0:11857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb95298b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265315.935529:0:11857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb95298b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265315.935586:0:11857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1789265315.935591:0:11857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789265315.935616:0:11857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb95298b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265315.935630:0:11857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb95298b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265315.935640:0:11857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb95297d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265315.935646:0:11857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb95297d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265315.935653:0:11857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb95297d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265315.935660:0:11857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad7000 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789265315.935665:0:11857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb95297d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265315.935672:0:11857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb95297d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265315.935685:0:11857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a101cdf4400) 00010000:00010000:2.0:1789265315.935688:0:11857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265315.935692:0:11857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb95297d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265315.935699:0:11857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb95297d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265315.935725:0:11857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952984 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265315.935732:0:11857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952984 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265315.935738:0:11857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952984 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265315.935744:0:11857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad6000 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789265315.935747:0:11857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952984 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265315.935753:0:11857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952984 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265315.935761:0:11857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8a1012931b00) 00010000:00010000:2.0:1789265315.935763:0:11857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265315.935766:0:11857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952984 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265315.935771:0:11857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952984 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265315.935806:0:11857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952976 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f001a expref: 45 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265315.935820:0:11857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb95298b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f001a expref: 44 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265315.935838:0:11857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a1032d00600) 00010000:00010000:2.0:1789265315.935841:0:11857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789265315.935844:0:11857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fad6c00, rc 0) 00000100:00100000:2.0:1789265315.935931:0:11857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c07a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+44:11421:x1876180397529472:12345-192.168.203.37@tcp:101:stat.0 Request processed in 742us (1077us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265315.935939:0:11857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 158 00000100:00100000:2.0:1789265316.040289:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265316.040409:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397529728 00000100:00100000:0.0:1789265316.040422:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397529728 00000100:00100000:0.0:1789265316.040510:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 159 00000100:00100000:0.0:1789265316.040523:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1041b72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+44:11431:x1876180397529728:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:0.0:1789265316.040550:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265316.040576:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35e00/0x27274ba5bb952992 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f0021 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265316.040707:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1789265316.040872:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35e00/0x27274ba5bb952992 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0021 expref: 46 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265316.040891:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1012931100) 00010000:00010000:0.0:1789265316.040913:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789265316.040920:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35e00/0x27274ba5bb952992 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0021 expref: 46 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265316.040937:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fa35e00, rc 0) 00000100:00100000:0.0:1789265316.041029:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1041b72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+45:11431:x1876180397529728:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 508us (753us total) trans 4294967446 rc 301/301 00000100:00100000:0.0:1789265316.041037:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 159 00000100:00100000:0.0:1789265316.047490:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265316.047711:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397529984 00000100:00100000:2.0:1789265316.047725:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397529984 00000100:00100000:2.0:1789265316.047805:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 44 00000100:00100000:2.0:1789265316.047818:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1010a43450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+45:11431:x1876180397529984:12345-192.168.203.37@tcp:35:lfs.0 00000100:00100000:2.0:1789265316.048202:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1010a43450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+46:11431:x1876180397529984:12345-192.168.203.37@tcp:35:lfs.0 Request processed in 385us (725us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1789265316.048211:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 44 00000040:00080000:3.0:1789265316.086509:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789265316.086526:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789265316.086819:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:3.0:1789265316.086827:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789265316.113940:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265316.114159:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397530240 00000100:00100000:3.0:1789265316.114174:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397530240 00000100:00100000:3.0:1789265316.114254:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 160 00000100:00100000:3.0:1789265316.114266:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103ba79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+46:11437:x1876180397530240:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:3.0:1789265316.114299:0:7934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265316.114327:0:7934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb9529a0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f0028 expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.114465:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb9529a7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.114484:0:7934:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb95298b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f001a expref: 47 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.114505:0:7934:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb9529a7 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.114552:0:7934:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb95298b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f001a expref: 47 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.114571:0:7934:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb95298b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f001a expref: 47 pid: 11857 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265316.114588:0:7934:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1008754700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7934:1876180414306688:192.168.203.37@tcp:104: 00000100:00100000:3.0:1789265316.114758:0:7934:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a0f0294c840 going to sleep for 11 seconds 00000100:00100000:3.0:1789265316.121304:0:7934:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1008754700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7934:1876180414306688:192.168.203.37@tcp:104: 00010000:00010000:3.0:1789265316.121345:0:7934:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb9529a7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265316.121859:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265316.121970:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397530368 00000100:00100000:2.0:1789265316.121981:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397530368 00010000:00010000:2.0:1789265316.122058:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb95298b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f001a expref: 48 pid: 11857 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265316.122139:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 67 00000100:00100000:2.0:1789265316.122151:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103ba7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+48:2350:x1876180397530368:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265316.122171:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265316.122179:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb95298b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f001a expref: 48 pid: 11857 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265316.122219:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb95298b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f001a expref: 48 pid: 11857 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265316.122247:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb95298b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f001a expref: 48 pid: 11857 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265316.122264:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a1032d00600) 00010000:00010000:2.0:1789265316.122271:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb9529a7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265316.122281:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb9529a7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265316.122291:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb9529a7 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265316.122322:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265316.122455:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103ba7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+47:2350:x1876180397530368:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 300us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265316.122463:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 67 00010000:00010000:3.0:1789265316.123247:0:7934:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb9529a7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.123262:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb9529a7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265316.123292:0:7934:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1789265316.123526:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb9529a0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0028 expref: 48 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.123548:0:7934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb9529a7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0028 expref: 47 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.123575:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a1032d00600) 00010000:00010000:3.0:1789265316.123578:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789265316.123582:0:7934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fae8800, rc 0) 00000100:00100000:3.0:1789265316.123638:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103ba79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+47:11437:x1876180397530240:12345-192.168.203.37@tcp:101:bash.0 Request processed in 9374us (9713us total) trans 4294967448 rc 0/0 00000100:00100000:3.0:1789265316.123647:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 160 00000100:00100000:0.0:1789265316.128844:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265316.129141:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397530624 00000100:00100000:3.0:1789265316.129156:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397530624 00000100:00100000:3.0:1789265316.129223:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 161 00000100:00100000:3.0:1789265316.129235:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102efe2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+47:11437:x1876180397530624:12345-192.168.203.37@tcp:36:bash.0 00010000:00010000:3.0:1789265316.129611:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8400/0x27274ba5bb9529b5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.129636:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8400/0x27274ba5bb9529b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.129650:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8400/0x27274ba5bb9529b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789265316.129709:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967449 00000004:00010000:3.0:1789265316.129736:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000962677d7 reply state 00000000a430ff23 transno 4294967450 ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8400/0x27274ba5bb9529b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265316.129745:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789265316.129875:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102efe2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+50:11437:x1876180397530624:12345-192.168.203.37@tcp:36:bash.0 Request processed in 641us (1048us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1789265316.129884:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 161 00000020:00080000:3.0:1789265316.129918:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789265316.135284:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00010000:00010000:3.0:1789265316.135390:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8400/0x27274ba5bb9529b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.135407:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8400/0x27274ba5bb9529b5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.135416:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8400/0x27274ba5bb9529b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.135423:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fae8400 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789265316.135429:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8400/0x27274ba5bb9529b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.135438:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8400/0x27274ba5bb9529b5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.135465:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a1032d00600) 00010000:00010000:3.0:1789265316.135469:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265316.135474:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8400/0x27274ba5bb9529b5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.135480:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8400/0x27274ba5bb9529b5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265316.139279:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397530752 00000100:00100000:2.0:1789265316.139303:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397530752 00000100:00100000:2.0:1789265316.139545:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 162 00000100:00100000:2.0:1789265316.139559:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103ba7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+49:11437:x1876180397530752:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:2.0:1789265316.139588:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265316.139628:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb9529bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f002f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265316.139780:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb9529c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265316.139800:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb9529a7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0028 expref: 50 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265316.139810:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb9529c3 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265316.139861:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb9529a7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0028 expref: 50 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265316.139882:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb9529a7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0028 expref: 50 pid: 7934 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265316.139909:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1041b73100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876180414306816:192.168.203.37@tcp:104: 00000100:00100000:2.0:1789265316.140057:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a0f02db6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789265316.144366:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265316.144821:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1041b73100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876180414306816:192.168.203.37@tcp:104: 00010000:00010000:2.0:1789265316.144860:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb9529c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265316.145343:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397530880 00000100:00100000:3.0:1789265316.145353:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397530880 00010000:00010000:3.0:1789265316.145406:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb9529a7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0028 expref: 51 pid: 7934 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265316.145567:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 68 00000100:00100000:3.0:1789265316.145579:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103ba7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+51:2350:x1876180397530880:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265316.145618:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265316.145627:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb9529a7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0028 expref: 51 pid: 7934 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.145643:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb9529a7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0028 expref: 51 pid: 7934 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.145672:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb9529a7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0028 expref: 51 pid: 7934 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.145692:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a1032d00600) 00010000:00010000:3.0:1789265316.145698:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb9529c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.145709:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb9529c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.145718:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb9529c3 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.145755:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265316.145832:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103ba7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+50:2350:x1876180397530880:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 255us (1481us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265316.145841:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 68 00010000:00010000:1.0:1789265316.146977:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb9529c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265316.147003:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb9529c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265316.147105:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789265316.147112:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789265316.147143:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb9529c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265316.147195:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb9529bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f002f expref: 50 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265316.147220:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb9529c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f002f expref: 49 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265316.147230:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a1032d00600) 00010000:00010000:1.0:1789265316.147234:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789265316.147238:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fad6a00, rc 0) 00000100:00100000:1.0:1789265316.147326:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103ba7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+49:11437:x1876180397530752:12345-192.168.203.37@tcp:101:bash.0 Request processed in 7769us (12056us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265316.147336:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 162 00010000:00010000:0.0:1789265316.149692:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265316.151524:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265316.151675:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397531136 00000100:00100000:2.0:1789265316.151689:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397531136 00000100:00100000:2.0:1789265316.151765:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 45 00000100:00100000:2.0:1789265316.151778:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103ba7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+49:11437:x1876180397531136:12345-192.168.203.37@tcp:35:bash.0 00000100:00100000:2.0:1789265316.152306:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103ba7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+50:11437:x1876180397531136:12345-192.168.203.37@tcp:35:bash.0 Request processed in 526us (794us total) trans 4294967451 rc 0/0 00000100:00100000:2.0:1789265316.152337:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 45 00000100:00100000:0.0:1789265316.241543:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265316.241755:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397531392 00000100:00100000:3.0:1789265316.241769:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397531392 00000100:00100000:3.0:1789265316.241908:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 163 00000100:00100000:3.0:1789265316.241922:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102efe0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+50:11447:x1876180397531392:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:3.0:1789265316.241976:0:7934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265316.242004:0:7934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb9529ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f0036 expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265316.242177:0:7934:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1789265316.242328:0:7934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb9529ca lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0036 expref: 52 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.242347:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1012931100) 00010000:00010000:3.0:1789265316.242350:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789265316.242356:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb9529ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0036 expref: 52 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.242374:0:7934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fae8800, rc 0) 00000100:00100000:3.0:1789265316.242449:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102efe0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+51:11447:x1876180397531392:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 530us (919us total) trans 4294967452 rc 301/301 00000100:00100000:3.0:1789265316.242457:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 163 00000100:00100000:0.0:1789265316.247838:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265316.248336:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397531520 00000100:00100000:3.0:1789265316.248351:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397531520 00000100:00100000:3.0:1789265316.248492:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 164 00000100:00100000:3.0:1789265316.248505:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102efe0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+51:11447:x1876180397531520:12345-192.168.203.37@tcp:34:lfs.0 00010000:00010000:3.0:1789265316.248621:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8400/0x27274ba5bb9529d8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.248643:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8400/0x27274ba5bb9529d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.248661:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8400/0x27274ba5bb9529d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.248703:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb9529df lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.248711:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb9529df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.248718:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb9529df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.248836:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb9529e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.248846:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb9529e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.248853:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb9529e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789265316.249515:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb9529e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.249536:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8400/0x27274ba5bb9529d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.249544:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8400/0x27274ba5bb9529d8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.249552:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8400/0x27274ba5bb9529d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.249559:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fae8400 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789265316.249565:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8400/0x27274ba5bb9529d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.249587:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8400/0x27274ba5bb9529d8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.249604:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a101cdf4400) 00010000:00010000:3.0:1789265316.249608:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265316.249615:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8400/0x27274ba5bb9529d8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.249621:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8400/0x27274ba5bb9529d8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.249639:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb9529df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.249645:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb9529df lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.249652:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb9529df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.249658:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fae8e00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789265316.249662:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb9529df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.249668:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb9529df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.249676:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8a1032d00100) 00010000:00010000:3.0:1789265316.249678:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265316.249681:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb9529df lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.249697:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb9529df lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.249715:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb9529e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.249722:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb9529e6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.249728:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb9529e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.249733:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fae9a00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789265316.249737:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb9529e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.249743:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb9529e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.249752:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a1032d00600) 00010000:00010000:3.0:1789265316.249754:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265316.249758:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb9529e6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.249764:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb9529e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265316.249956:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102efe0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+51:11447:x1876180397531520:12345-192.168.203.37@tcp:34:lfs.0 Request processed in 1373us (2052us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265316.249969:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 164 00000100:00100000:0.0:1789265316.253204:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265316.253278:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397531776 00000100:00100000:1.0:1789265316.253290:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397531776 00000100:00100000:1.0:1789265316.253392:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 46 00000100:00100000:1.0:1789265316.253419:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102efe1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+51:11447:x1876180397531776:12345-192.168.203.37@tcp:35:lfs.0 00000100:00100000:1.0:1789265316.253720:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102efe1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+52:11447:x1876180397531776:12345-192.168.203.37@tcp:35:lfs.0 Request processed in 301us (529us total) trans 4294967453 rc 0/0 00000100:00100000:1.0:1789265316.253729:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 46 00000100:00100000:0.0:1789265316.293547:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265316.293708:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397532032 00000100:00100000:1.0:1789265316.293722:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397532032 00000100:00100000:1.0:1789265316.293802:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 165 00000100:00100000:1.0:1789265316.293813:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102efe0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+52:11450:x1876180397532032:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:1.0:1789265316.293845:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265316.293874:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb9529ed lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f003d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265316.293976:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596200/0x27274ba5bb9529f4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265316.294006:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596200/0x27274ba5bb9529f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265316.294029:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596200/0x27274ba5bb9529f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265316.294048:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb9529fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265316.294055:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb9529fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265316.294061:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb9529fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265316.294296:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb952a02 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265316.294306:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb952a02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265316.294313:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb952a02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265316.294324:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789265316.294574:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596200/0x27274ba5bb9529f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265316.294584:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596200/0x27274ba5bb9529f4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265316.294591:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596200/0x27274ba5bb9529f4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265316.294597:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b596200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789265316.294602:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596200/0x27274ba5bb9529f4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265316.294611:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596200/0x27274ba5bb9529f4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265316.294626:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a101cdf4400) 00010000:00010000:1.0:1789265316.294629:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265316.294635:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596200/0x27274ba5bb9529f4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265316.294653:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596200/0x27274ba5bb9529f4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265316.294670:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb9529fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265316.294676:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb9529fb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265316.294683:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb9529fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265316.294688:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b597200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789265316.294691:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb9529fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265316.294698:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb9529fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265316.294706:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8a101cdf4d00) 00010000:00010000:1.0:1789265316.294709:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265316.294712:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb9529fb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265316.294718:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb9529fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265316.294772:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb9529ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f003d expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265316.294787:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb952a02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f003d expref: 54 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265316.294801:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a1032d00600) 00010000:00010000:1.0:1789265316.294803:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789265316.294806:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a101b597c00, rc 0) 00000100:00100000:1.0:1789265316.294884:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102efe0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+54:11450:x1876180397532032:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 1071us (1350us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1789265316.294893:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 165 00000100:00100000:0.0:1789265316.299693:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265316.299755:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265316.299915:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397532288 00000100:00100000:2.0:1789265316.299928:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397532288 00000100:00100000:2.0:1789265316.300036:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 13 00000100:00100000:2.0:1789265316.300049:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102efe1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+54:2348:x1876180397532288:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265316.300069:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265316.300315:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb952a02 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f003d expref: 54 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265316.300339:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a1032d00600) 00010000:00010000:2.0:1789265316.300345:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265316.300463:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102efe1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+53:2348:x1876180397532288:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 417us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265316.300473:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 13 00000100:00100000:3.0:1789265316.300704:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397532160 00000100:00100000:3.0:1789265316.300712:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397532160 00000100:00100000:3.0:1789265316.300769:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 166 00000100:00100000:3.0:1789265316.300777:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102efe3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+53:11450:x1876180397532160:12345-192.168.203.37@tcp:54:lfs.0 00010000:00010000:3.0:1789265316.300855:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb952a10 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.300873:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb952a10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.300887:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb952a10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.300923:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb952a10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.300930:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb952a10 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.300937:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb952a10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.300943:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fae9a00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789265316.300948:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb952a10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.300956:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb952a10 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.300965:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a1032d00600) 00010000:00010000:3.0:1789265316.300968:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789265316.300972:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb952a10 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.301022:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb952a10 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265316.301107:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102efe3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+53:11450:x1876180397532160:12345-192.168.203.37@tcp:54:lfs.0 Request processed in 300us (1398us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265316.301115:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 166 00000100:00100000:0.0:1789265316.311163:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265316.311449:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397532544 00000100:00100000:2.0:1789265316.311463:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397532544 00000100:00100000:2.0:1789265316.311542:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 47 00000100:00100000:2.0:1789265316.311555:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102efe3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+53:11450:x1876180397532544:12345-192.168.203.37@tcp:35:lfs.0 00000100:00100000:2.0:1789265316.312118:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102efe3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+54:11450:x1876180397532544:12345-192.168.203.37@tcp:35:lfs.0 Request processed in 563us (969us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1789265316.312128:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 47 00000100:00100000:1.0:1789265316.471674:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265316.471853:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397532800 00000100:00100000:3.0:1789265316.471868:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397532800 00000100:00100000:3.0:1789265316.472053:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 167 00000100:00100000:3.0:1789265316.472066:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103ba7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+54:11468:x1876180397532800:12345-192.168.203.37@tcp:101:cat.0 00010000:00010000:3.0:1789265316.472145:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265316.472175:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb952a17 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f0044 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.472394:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb952a1e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.472413:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb952a1e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.472428:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb952a1e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265316.472454:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789265316.472622:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb952a17 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0044 expref: 57 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.472646:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb952a1e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0044 expref: 56 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.472676:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a1032d00600) 00010000:00010000:3.0:1789265316.472679:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789265316.472683:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fae8e00, rc 0) 00000100:00100000:3.0:1789265316.473279:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103ba7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+56:11468:x1876180397532800:12345-192.168.203.37@tcp:101:cat.0 Request processed in 1209us (1614us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1789265316.473290:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 167 00000100:00100000:0.0:1789265316.507260:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265316.507849:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397532928 00000100:00100000:3.0:1789265316.507881:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397532928 00000100:00100000:3.0:1789265316.507964:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 168 00000100:00100000:3.0:1789265316.507978:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102efe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+56:11469:x1876180397532928:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:3.0:1789265316.508022:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265316.508057:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb952a2c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f004b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.508658:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8400/0x27274ba5bb952a33 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.508678:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8400/0x27274ba5bb952a33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.508693:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8400/0x27274ba5bb952a33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265316.508746:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1789265316.508751:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789265316.508776:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8400/0x27274ba5bb952a33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.508834:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb952a2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f004b expref: 58 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.508872:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8400/0x27274ba5bb952a33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f004b expref: 57 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.509964:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a101cdf4400) 00010000:00010000:3.0:1789265316.509968:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789265316.509973:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fae8400, rc 0) 00000100:00100000:3.0:1789265316.510113:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102efe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+57:11469:x1876180397532928:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 2134us (2876us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265316.510123:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 168 00000100:00100000:0.0:1789265316.515612:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265316.515723:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397533312 00000100:00100000:1.0:1789265316.515736:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397533312 00000100:00100000:1.0:1789265316.515802:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 48 00000100:00100000:1.0:1789265316.515813:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102efe0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+57:11469:x1876180397533312:12345-192.168.203.37@tcp:35:lfs.0 00000100:00100000:1.0:1789265316.516582:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102efe0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+58:11469:x1876180397533312:12345-192.168.203.37@tcp:35:lfs.0 Request processed in 767us (981us total) trans 4294967457 rc 0/0 00000100:00100000:1.0:1789265316.516592:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 48 00000100:00100000:1.0:1789265316.520315:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265316.520612:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397533440 00000100:00100000:0.0:1789265316.520626:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397533440 00000100:00100000:0.0:1789265316.520718:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 14 00000100:00100000:0.0:1789265316.520730:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10118e4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+58:11469:x1876180397533440:12345-192.168.203.37@tcp:103:lfs.0 00010000:00010000:0.0:1789265316.520751:0:8490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789265316.520784:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb9529c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f002f expref: 58 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265316.520839:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb952a1e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0044 expref: 57 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265316.520864:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb9528ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efff0 expref: 56 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265316.520875:0:8490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a1032d00600) 00010000:00010000:0.0:1789265316.520888:0:8490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265316.520962:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10118e4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+55:11469:x1876180397533440:12345-192.168.203.37@tcp:103:lfs.0 Request processed in 234us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265316.520971:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 14 00000100:00100000:0.0:1789265316.524056:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265316.525557:0:11857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397533568 00000100:00100000:2.0:1789265316.525576:0:11857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397533568 00000100:00100000:2.0:1789265316.525765:0:11857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 169 00000100:00100000:2.0:1789265316.525779:0:11857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102efe2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+55:11469:x1876180397533568:12345-192.168.203.37@tcp:58:lfs.0 00010000:00010000:2.0:1789265316.525976:0:11857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952a3a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265316.526018:0:11857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952a3a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265316.526032:0:11857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952a3a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789265316.526393:0:11857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1789265316.526529:0:11857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102efe2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+55:11469:x1876180397533568:12345-192.168.203.37@tcp:58:lfs.0 Request processed in 751us (2488us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265316.526538:0:11857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 169 00000100:00100000:0.0:1789265316.552565:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265316.552957:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397533696 00000100:00100000:3.0:1789265316.552971:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397533696 00000100:00100000:3.0:1789265316.553174:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 170 00000100:00100000:3.0:1789265316.553186:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102efe1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+55:11471:x1876180397533696:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:3.0:1789265316.553212:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265316.553236:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb952a41 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f0052 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.553323:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb952a48 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.553340:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb952a48 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.553355:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb952a48 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.553390:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9c00/0x27274ba5bb952a4f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.553397:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9c00/0x27274ba5bb952a4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.553403:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9c00/0x27274ba5bb952a4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.553508:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9000/0x27274ba5bb952a56 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.553516:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9000/0x27274ba5bb952a56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.553523:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9000/0x27274ba5bb952a56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265316.553565:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789265316.553570:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789265316.553591:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9000/0x27274ba5bb952a56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.553604:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9000/0x27274ba5bb952a56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.553613:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb952a48 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.553620:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb952a48 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.553638:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb952a48 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.553644:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fae8800 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789265316.553650:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb952a48 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.553658:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb952a48 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.553673:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a101cdf4400) 00010000:00010000:3.0:1789265316.553676:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265316.553681:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb952a48 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.553688:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb952a48 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.553703:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9c00/0x27274ba5bb952a4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.553709:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9c00/0x27274ba5bb952a4f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.553715:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9c00/0x27274ba5bb952a4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.553732:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fae9c00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789265316.553735:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9c00/0x27274ba5bb952a4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.553750:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9c00/0x27274ba5bb952a4f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.553758:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8a1032d00100) 00010000:00010000:3.0:1789265316.553760:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265316.553764:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9c00/0x27274ba5bb952a4f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.553769:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9c00/0x27274ba5bb952a4f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.553804:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb952a41 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0052 expref: 57 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.553817:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9000/0x27274ba5bb952a56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0052 expref: 56 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265316.553825:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a1012931b00) 00010000:00010000:3.0:1789265316.553827:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789265316.553829:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fae9000, rc 0) 00000100:00100000:3.0:1789265316.555148:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102efe1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+56:11471:x1876180397533696:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 1951us (2585us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265316.555170:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 170 00000100:00100000:1.0:1789265316.660034:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103ba79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414307328:0@lo:400:kworker.0 00000100:00100000:1.0:1789265316.660153:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265316.660230:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789265316.660240:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103ba7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1876180414307200:0@lo:400:kworker.0 00000100:00100000:1.0:1789265316.660270:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265316.660307:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414307328 00000100:00100000:1.0:1789265316.660315:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414307328 00000100:00100000:1.0:1789265316.660374:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789265316.660384:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103ba78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3318:x1876180414307328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265316.661592:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103ba78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3318:x1876180414307328:12345-0@lo:400:kworker.0 Request processed in 1204us (1433us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265316.661607:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:1.0:1789265316.661651:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265316.661694:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103ba79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414307328:0@lo:400:kworker.0 00000100:00100000:1.0:1789265316.661748:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414307200 00000100:00100000:1.0:1789265316.661753:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414307200 00000100:00100000:1.0:1789265316.661804:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789265316.661813:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103ba78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1876180414307200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265316.661870:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103ba78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1876180414307200:12345-0@lo:400:kworker.0 Request processed in 59us (1599us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265316.661877:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:1.0:1789265316.661894:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265316.661917:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103ba7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1876180414307200:0@lo:400:kworker.0 00000100:00100000:0.0:1789265316.662096:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103ba78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876180414307072:0@lo:400:kworker.0 00000100:00100000:0.0:1789265316.662141:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265316.662170:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103ba7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414307584:0@lo:400:kworker.0 00000100:00100000:0.0:1789265316.662197:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265316.662216:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789265316.662222:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103ba79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:871daf34-1206-40e7-bd71-78303abe4d37:3316:1876180414306944:0@lo:400:kworker.0 00000100:00100000:0.0:1789265316.662249:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265316.662273:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103ba78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1876180414307456:0@lo:400:kworker.0 00000100:00100000:0.0:1789265316.662296:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265316.662319:0:11857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414307072 00000100:00100000:0.0:1789265316.662323:0:11857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414307072 00000100:00100000:0.0:1789265316.662346:0:11857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414307456 00000100:00100000:0.0:1789265316.662360:0:11857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414307456 00000100:00100000:0.0:1789265316.662386:0:11857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789265316.662393:0:11857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102efe1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876180414307072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265316.662431:0:11857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102efe1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876180414307072:12345-0@lo:400:kworker.0 Request processed in 38us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265316.662438:0:11857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:1.0:1789265316.662559:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265316.662572:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414307584 00000100:00100000:1.0:1789265316.662577:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414307584 00000100:00100000:1.0:1789265316.662617:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789265316.662627:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102efe1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414307584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265316.662665:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102efe1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414307584:12345-0@lo:400:kworker.0 Request processed in 42us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265316.662672:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:1.0:1789265316.662694:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789265316.662705:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789265316.662713:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10037b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876180414307456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265316.662748:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10037b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876180414307456:12345-0@lo:400:kworker.0 Request processed in 37us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265316.662764:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789265316.662807:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414306944 00000100:00100000:1.0:1789265316.662812:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414306944 00000100:00100000:1.0:1789265316.662844:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1789265316.662852:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+19:3316:x1876180414306944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265316.662890:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+19:3316:x1876180414306944:12345-0@lo:400:kworker.0 Request processed in 40us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265316.662896:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1789265316.662951:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103ba79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:871daf34-1206-40e7-bd71-78303abe4d37:3316:1876180414306944:0@lo:400:kworker.0 00000100:00100000:1.0:1789265316.662965:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103ba78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1876180414307456:0@lo:400:kworker.0 00000100:00100000:1.0:1789265316.662975:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103ba78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876180414307072:0@lo:400:kworker.0 00000100:00100000:1.0:1789265316.662984:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103ba7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414307584:0@lo:400:kworker.0 00000100:00100000:1.0:1789265317.106061:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265317.106140:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265317.106173:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265317.106216:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265317.106253:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397534080 00000100:00100000:1.0:1789265317.106268:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397534080 00000100:00100000:2.0:1789265317.106468:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397533824 00000100:00100000:2.0:1789265317.106474:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397533824 00000100:00100000:2.0:1789265317.106522:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 291 00000100:00100000:2.0:1789265317.106534:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1230cd-a81b-4bcc-a532-e24f5353fef4+13:2351:x1876180397533824:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789265317.106634:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1230cd-a81b-4bcc-a532-e24f5353fef4+13:2351:x1876180397533824:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 102us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265317.106642:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 291 00000100:00100000:1.0:1789265317.107115:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397533952 00000100:00100000:1.0:1789265317.107120:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397533952 00000100:00100000:1.0:1789265317.107152:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 85 00000100:00100000:1.0:1789265317.107161:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103ba7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:2351:x1876180397534080:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789265317.107219:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103ba7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:2351:x1876180397534080:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 58us (1077us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265317.107242:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 85 00000100:00100000:1.0:1789265317.107260:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 86 00000100:00100000:1.0:1789265317.107266:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103ba78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+7:2351:x1876180397533952:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789265317.107298:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103ba78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+7:2351:x1876180397533952:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 31us (1124us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265317.107307:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 86 00000100:00080000:3.0:1789265317.107394:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789265317.107406:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789265317.107422:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397534208 00000100:00100000:3.0:1789265317.107435:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397534208 00000100:00100000:3.0:1789265317.107598:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 142 00000100:00100000:3.0:1789265317.107614:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103ba78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+5:2351:x1876180397534208:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789265317.107717:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103ba78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+5:2351:x1876180397534208:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 109us (1499us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265317.107727:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 142 00000100:00080000:3.0:1789265317.107757:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:2.0:1789265317.113479:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789265317.113494:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789265317.113544:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1789265317.113551:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789265317.113721:0:11671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1041b73100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11671:1876180414307712:192.168.203.37@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789265317.113862:0:11671:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a0f02db6600 going to sleep for 11 seconds 00000100:00100000:0.0:1789265317.118752:0:11671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1041b73100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11671:1876180414307712:192.168.203.37@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789265317.123066:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265317.123553:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397534336 00000100:00100000:1.0:1789265317.123575:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397534336 00000100:00100000:1.0:1789265317.123677:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 171 00000100:00100000:1.0:1789265317.123690:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1009071500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+56:11482:x1876180397534336:12345-192.168.203.37@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789265317.123737:0:7934:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789265317.123899:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1009071500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+56:11482:x1876180397534336:12345-192.168.203.37@tcp:53:lhsmtool_posix.0 Request processed in 211us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265317.123908:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 171 00000100:00080000:0.0:1789265317.124716:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265317.130984:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265317.131049:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397534464 00000100:00100000:3.0:1789265317.131062:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397534464 00000100:00100000:3.0:1789265317.131185:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 172 00000100:00100000:3.0:1789265317.131198:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008754700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+56:11482:x1876180397534464:12345-192.168.203.37@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789265317.131317:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb952a5d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.131340:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb952a5d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.131355:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb952a5d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.132013:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9c00/0x27274ba5bb952a64 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.132042:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9c00/0x27274ba5bb952a64 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.132057:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9c00/0x27274ba5bb952a64 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.132154:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb952a6b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.132184:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb952a6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.132193:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb952a6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265317.132246:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789265317.132250:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789265317.132268:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb952a6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.132281:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb952a5d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.132289:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb952a5d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.132296:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb952a5d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.132304:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fae9a00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789265317.132308:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb952a5d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.132318:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb952a5d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.132333:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a1032d00f00) 00010000:00010000:3.0:1789265317.132337:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265317.132341:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb952a5d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.132362:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb952a5d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.132381:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9c00/0x27274ba5bb952a64 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.132388:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9c00/0x27274ba5bb952a64 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.132394:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9c00/0x27274ba5bb952a64 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.132401:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fae9c00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789265317.132404:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9c00/0x27274ba5bb952a64 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.132410:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9c00/0x27274ba5bb952a64 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.132418:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff8a1032d00100) 00010000:00010000:3.0:1789265317.132421:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265317.132424:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9c00/0x27274ba5bb952a64 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.132590:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9c00/0x27274ba5bb952a64 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.132611:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb952a6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.132617:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb952a6b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.132631:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb952a6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.132636:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fae8800 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789265317.132639:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb952a6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.132646:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb952a6b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.132655:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a1012931b00) 00010000:00010000:3.0:1789265317.132658:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265317.132661:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb952a6b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.132666:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb952a6b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265317.132838:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008754700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+56:11482:x1876180397534464:12345-192.168.203.37@tcp:34:lhsmtool_posix.0 Request processed in 1638us (1867us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265317.132849:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 172 00000100:00100000:2.0:1789265317.142709:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265317.142801:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397534720 00000100:00100000:3.0:1789265317.142817:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397534720 00000100:00100000:3.0:1789265317.142898:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 173 00000100:00100000:3.0:1789265317.142909:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1041b73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+56:11482:x1876180397534720:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789265317.142930:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265317.142949:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8600/0x27274ba5bb952a72 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f0059 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.143120:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb952a79 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.143136:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb952a79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.143147:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb952a79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265317.143158:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789265317.143255:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb952a79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.143263:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb952a79 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.143270:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb952a79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.143277:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fae9200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789265317.143281:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb952a79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.143288:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb952a79 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.143300:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a1012931b00) 00010000:00010000:3.0:1789265317.143303:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789265317.143307:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb952a79 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.143324:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb952a79 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.143370:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8600/0x27274ba5bb952a72 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0059 expref: 58 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.143380:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a1032d00f00) 00010000:00010000:3.0:1789265317.143382:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789265317.143386:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8600/0x27274ba5bb952a72 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0059 expref: 58 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.143397:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fae8600, rc 0) 00000100:00100000:3.0:1789265317.144904:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1041b73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+57:11482:x1876180397534720:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 1988us (2200us total) trans 4294967458 rc 301/301 00000100:00100000:3.0:1789265317.144916:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 173 00000100:00100000:0.0:1789265317.149608:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265317.149688:0:11857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397534848 00000100:00100000:1.0:1789265317.149706:0:11857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397534848 00000100:00100000:1.0:1789265317.149791:0:11857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 174 00000100:00100000:1.0:1789265317.149803:0:11857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bb05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+57:11482:x1876180397534848:12345-192.168.203.37@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789265317.149852:0:11857:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789265317.150001:0:11857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bb05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+57:11482:x1876180397534848:12345-192.168.203.37@tcp:53:lhsmtool_posix.0 Request processed in 199us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265317.150020:0:11857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 174 00000100:00100000:0.0:1789265317.159995:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265317.163844:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397535104 00000100:00100000:3.0:1789265317.163935:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397535104 00000100:00100000:3.0:1789265317.164143:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 175 00000100:00100000:3.0:1789265317.164157:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02e31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+57:11482:x1876180397535104:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789265317.164185:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265317.164189:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789265317.164227:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8400/0x27274ba5bb952a33 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f004b expref: 57 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.164247:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a101cdf4400) 00010000:00010000:3.0:1789265317.164253:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789265317.164281:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8600/0x27274ba5bb952a87 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f0060 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789265317.165574:0:5842:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1789265317.165871:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb952a8e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.165892:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb952a8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.165906:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb952a8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.165989:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8600/0x27274ba5bb952a87 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0060 expref: 59 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.166022:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb952a8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0060 expref: 58 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.166031:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8a1012931d00) 00010000:00010000:2.0:1789265317.166034:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789265317.166037:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fad6200, rc 0) 00000100:00100000:2.0:1789265317.166168:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02e31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+58:11482:x1876180397535104:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 2012us (6187us total) trans 4294967459 rc 0/0 00000100:00100000:2.0:1789265317.166178:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 175 00000100:00100000:2.0:1789265317.169627:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265317.169879:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397535360 00000100:00100000:3.0:1789265317.169893:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397535360 00000100:00100000:3.0:1789265317.170000:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 176 00000100:00100000:3.0:1789265317.170023:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1041b72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+58:11482:x1876180397535360:12345-192.168.203.37@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789265317.170174:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265317.170212:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb952a8e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0060 expref: 58 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.170250:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8a1012931d00) 00010000:00010000:3.0:1789265317.170263:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789265317.170295:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb952a9c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.170311:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb952a9c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.170323:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb952a9c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.170341:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb952aa3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xde174e09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.170347:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb952aa3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xde174e09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.170354:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb952aa3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xde174e09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.170451:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb952a9c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.170460:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb952a9c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.170466:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb952a9c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.170472:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fae9200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789265317.170477:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb952a9c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.170499:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb952a9c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.170509:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a101cdf4400) 00010000:00010000:3.0:1789265317.170513:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265317.170517:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb952a9c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.170524:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb952a9c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.170534:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb952aa3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xde174e09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.170540:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb952aa3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xde174e09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.170546:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb952aa3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xde174e09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.170557:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fae8800 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789265317.170560:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb952aa3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xde174e09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.170566:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb952aa3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xde174e09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.170574:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xde174e09 (ffff8a1032d00100) 00010000:00010000:3.0:1789265317.170577:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265317.170579:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb952aa3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xde174e09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.170585:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb952aa3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xde174e09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265317.170693:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1041b72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+57:11482:x1876180397535360:12345-192.168.203.37@tcp:36:lhsmtool_posix.0 Request processed in 671us (1075us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789265317.170702:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 176 00010000:00010000:2.0:1789265317.170967:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265317.173048:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02df5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414307840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789265317.173162:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265317.173258:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414307840 00000100:00100000:2.0:1789265317.173267:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414307840 00000100:00100000:2.0:1789265317.173323:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789265317.173333:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02df4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876180414307840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789265317.173389:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789265317.173452:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02df4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876180414307840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265317.173460:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789265317.173529:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02df5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414307840:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789265317.180705:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265317.180862:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397535488 00000100:00100000:2.0:1789265317.180877:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397535488 00000100:00100000:2.0:1789265317.181010:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 177 00000100:00100000:2.0:1789265317.181024:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103ba79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+57:11482:x1876180397535488:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789265317.181053:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265317.181130:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb952aaa lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f0067 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.181182:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb952ab1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.181199:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb952ab1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.181213:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb952ab1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.181349:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb952aaa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0067 expref: 59 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.181375:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb952ab1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0067 expref: 58 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.181396:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8a1012931200) 00010000:00010000:2.0:1789265317.181399:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789265317.181403:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fad7400, rc 0) 00000100:00100000:2.0:1789265317.181487:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103ba79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+58:11482:x1876180397535488:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 466us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265317.181494:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 177 00000100:00100000:0.0:1789265317.189722:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265317.189808:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397535744 00000100:00100000:2.0:1789265317.189824:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397535744 00000100:00100000:2.0:1789265317.189917:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 178 00000100:00100000:2.0:1789265317.189932:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02e30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+58:11482:x1876180397535744:12345-192.168.203.37@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789265317.190066:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7e00/0x27274ba5bb952ab8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.190125:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7e00/0x27274ba5bb952ab8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.190142:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7e00/0x27274ba5bb952ab8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789265317.190609:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:2.0:1789265317.190622:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 362995545951ns, next at 363995543166ns, rc = 0 00000004:00010000:2.0:1789265317.190811:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000001683661 reply state 000000008821ee26 transno 4294967460 ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7e00/0x27274ba5bb952ab8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265317.190824:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789265317.190966:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02e30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+60:11482:x1876180397535744:12345-192.168.203.37@tcp:36:lhsmtool_posix.0 Request processed in 1029us (1255us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1789265317.190987:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 178 00000100:00100000:2.0:1789265317.197631:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265317.201884:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397535872 00000100:00100000:0.0:1789265317.201909:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397535872 00010000:00010000:3.0:1789265317.202172:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7e00/0x27274ba5bb952ab8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.202189:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7e00/0x27274ba5bb952ab8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.202200:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7e00/0x27274ba5bb952ab8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.202209:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad7e00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789265317.202215:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7e00/0x27274ba5bb952ab8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.202235:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7e00/0x27274ba5bb952ab8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.203171:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8a1012931200) 00010000:00010000:3.0:1789265317.203180:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789265317.203189:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7e00/0x27274ba5bb952ab8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.203198:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7e00/0x27274ba5bb952ab8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265317.204703:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 179 00000100:00100000:0.0:1789265317.204733:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02df5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+59:11482:x1876180397535872:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789265317.204772:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265317.204813:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35e00/0x27274ba5bb952abf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f006e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265317.204893:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35e00/0x27274ba5bb952abf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f006e expref: 60 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265317.204911:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35e00/0x27274ba5bb952abf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f006e expref: 60 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265317.204934:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8a1012931200) 00010000:00010000:0.0:1789265317.204950:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789265317.204955:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fa35e00, rc 0) 00000100:00100000:0.0:1789265317.205067:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02df5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+60:11482:x1876180397535872:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 348us (7452us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265317.205102:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 179 00000100:00100000:3.0:1789265317.216964:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265317.219242:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397536000 00000100:00100000:1.0:1789265317.219276:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397536000 00000100:00100000:1.0:1789265317.220929:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 50 00000100:00100000:1.0:1789265317.220953:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c0d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:2350:x1876180397536000:12345-192.168.203.37@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789265317.221478:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c0d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+7:2350:x1876180397536000:12345-192.168.203.37@tcp:2:lhsmtool_posix.0 Request processed in 533us (4528us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1789265317.221488:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 50 00000100:00100000:3.0:1789265317.226519:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265317.226650:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397536256 00000100:00100000:0.0:1789265317.226725:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397536256 00000100:00100000:0.0:1789265317.226810:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 49 00000100:00100000:0.0:1789265317.226823:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+60:11482:x1876180397536256:12345-192.168.203.37@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789265317.227415:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+61:11482:x1876180397536256:12345-192.168.203.37@tcp:35:lhsmtool_posix.0 Request processed in 590us (908us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1789265317.227427:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 49 00000100:00100000:2.0:1789265317.230744:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265317.231064:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397536512 00000100:00100000:3.0:1789265317.231164:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397536512 00000100:00100000:3.0:1789265317.231275:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 180 00000100:00100000:3.0:1789265317.231287:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02df7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+61:11482:x1876180397536512:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789265317.231688:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02df7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+61:11482:x1876180397536512:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 Request processed in 401us (1033us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265317.231696:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 180 00000100:00100000:3.0:1789265317.237530:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265317.237635:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397536640 00000100:00100000:2.0:1789265317.237648:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397536640 00000100:00100000:2.0:1789265317.237850:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 181 00000100:00100000:2.0:1789265317.237864:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+61:11482:x1876180397536640:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789265317.237910:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265317.237943:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb952ac6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f0075 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.238281:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7e00/0x27274ba5bb952acd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.238299:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7e00/0x27274ba5bb952acd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.238313:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7e00/0x27274ba5bb952acd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265317.238359:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789265317.239042:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7e00/0x27274ba5bb952acd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.239116:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb952ac6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0075 expref: 63 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.239139:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7e00/0x27274ba5bb952acd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0075 expref: 62 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.239167:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8a1012931200) 00010000:00010000:2.0:1789265317.239175:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789265317.239180:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fad7e00, rc 0) 00000100:00100000:2.0:1789265317.239280:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+62:11482:x1876180397536640:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 1417us (1764us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265317.239289:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 181 00000100:00100000:1.0:1789265317.242373:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265317.242506:0:12007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397536768 00000100:00100000:0.0:1789265317.242522:0:12007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397536768 00000100:00100000:0.0:1789265317.242607:0:12007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 51 00000100:00100000:0.0:1789265317.242620:0:12007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103ba7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+7:2348:x1876180397536768:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789265317.242645:0:12007:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265317.242680:0:12007:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000045308fd5/0x27274ba5bb952ad4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f007c expref: -99 pid: 12007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789265317.242722:0:12007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa605a5, blocks: 0x1 00010000:00010000:0.0:1789265317.242749:0:12007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=363s v=(0 0) 00010000:00010000:0.0:1789265317.242756:0:12007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265317.242768:0:12007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045308fd5/0x27274ba5bb952ad4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f007c expref: 8 pid: 12007 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265317.242822:0:12007:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000045308fd5/0x27274ba5bb952ad4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f007c expref: 8 pid: 12007 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265317.242841:0:12007:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fa34400, rc 0) 00000100:00100000:0.0:1789265317.242930:0:12007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103ba7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+8:2348:x1876180397536768:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 313us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265317.242938:0:12007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 51 00000100:00100000:3.0:1789265317.247449:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265317.247501:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397537024 00000100:00100000:0.0:1789265317.247515:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397537024 00000100:00100000:0.0:1789265317.247672:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 182 00000100:00100000:0.0:1789265317.247685:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+62:11482:x1876180397537024:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789265317.247846:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+62:11482:x1876180397537024:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 Request processed in 163us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265317.247855:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 182 00000100:00100000:2.0:1789265317.258402:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265317.258616:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397537152 00000100:00100000:1.0:1789265317.258630:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397537152 00000100:00100000:1.0:1789265317.258782:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 52 00000100:00100000:1.0:1789265317.258797:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02df5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+8:11482:x1876180397537152:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789265317.258821:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265317.258850:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa362635/0x27274ba5bb952adb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f0083 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265317.259304:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000045308fd5/0x27274ba5bb952ad4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f007c expref: 9 pid: 12007 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265317.259405:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265317.259411:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265317.259418:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa362635/0x27274ba5bb952adb lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0083 expref: 9 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265317.259724:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000045308fd5/0x27274ba5bb952ad4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f007c expref: 9 pid: 12007 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265317.259773:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000045308fd5/0x27274ba5bb952ad4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f007c expref: 9 pid: 12007 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265317.259792:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103ba79500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6682:1876180414307968:192.168.203.37@tcp:104: 00000100:00100000:1.0:1789265317.260184:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10107f2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789265317.266010:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103ba79500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6682:1876180414307968:192.168.203.37@tcp:104: 00010000:00010000:3.0:1789265317.266066:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fa362635/0x27274ba5bb952adb lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0083 expref: 9 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.266149:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a101b596e00, rc 0) 00000100:00100000:2.0:1789265317.275027:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265317.276879:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397537280 00000100:00100000:1.0:1789265317.276893:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397537280 00010000:00010000:1.0:1789265317.276944:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000045308fd5/0x27274ba5bb952ad4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f007c expref: 10 pid: 12007 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265317.277010:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 69 00000100:00100000:1.0:1789265317.277021:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02df5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+10:2351:x1876180397537280:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265317.277034:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265317.277055:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000045308fd5/0x27274ba5bb952ad4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f007c expref: 10 pid: 12007 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265317.277071:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000045308fd5/0x27274ba5bb952ad4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f007c expref: 10 pid: 12007 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265317.277120:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000045308fd5/0x27274ba5bb952ad4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f007c expref: 10 pid: 12007 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265317.277137:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265317.277156:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265317.277165:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fa362635/0x27274ba5bb952adb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0083 expref: 9 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265317.277174:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa362635/0x27274ba5bb952adb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0083 expref: 9 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265317.277213:0:5827:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fa362635/0x27274ba5bb952adb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0083 expref: 9 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265317.277227:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103ba79f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5827:1876180414308096:192.168.203.37@tcp:105: 00000100:00100000:1.0:1789265317.277313:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10107f2840 going to sleep for 11 seconds 00000100:00100000:3.0:1789265317.278110:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02df5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+9:11482:x1876180397537152:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 19311us (19719us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265317.278121:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 52 00000100:00100000:2.0:1789265317.293892:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265317.294998:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397537408 00000100:00100000:3.0:1789265317.295027:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397537408 00002000:00100000:3.0:1789265317.295139:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8a0f02df7b80 x1876180397537408/t0(0) o4->4b820fcb-1bab-4b78-bfa4-355c22a09cf8@192.168.203.37@tcp:643/0 lens 504/0 e 0 to 0 dl 1789265328 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789265317.295154:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a0f02df7b80 with x1876180397537408 ext(0->8) 00002000:00010000:3.0:1789265317.295160:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a0f02df7b80 00000100:00100000:3.0:1789265317.295198:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 4 00000100:00100000:3.0:1789265317.295209:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02df7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+9:2351:x1876180397537408:12345-192.168.203.37@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789265317.295869:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02df7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+11:2351:x1876180397537408:12345-192.168.203.37@tcp:4:lhsmtool_posix.0 Request processed in 659us (1991us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1789265317.295881:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 4 00002000:00100000:3.0:1789265317.295890:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8a0f02df7b80 x1876180397537408/t4294967314(0) o4->4b820fcb-1bab-4b78-bfa4-355c22a09cf8@192.168.203.37@tcp:643/0 lens 504/448 e 0 to 0 dl 1789265328 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789265317.295899:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a0f02df7b80 with x1876180397537408 ext(0->8) 00002000:00010000:3.0:1789265317.295903:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a0f02df7b80 00000100:00100000:1.0:1789265317.297256:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103ba79f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5827:1876180414308096:192.168.203.37@tcp:105: 00010000:00010000:1.0:1789265317.297475:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265317.297645:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02df5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+10:2351:x1876180397537280:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 20624us (22641us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265317.297658:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 69 00000100:00100000:0.0:1789265317.307028:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265317.307286:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397537536 00000100:00100000:3.0:1789265317.307297:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397537536 00000100:00100000:3.0:1789265317.307371:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 183 00000100:00100000:3.0:1789265317.307381:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02e32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+62:11482:x1876180397537536:12345-192.168.203.37@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1789265317.448450:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02e32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+62:11482:x1876180397537536:12345-192.168.203.37@tcp:44:lhsmtool_posix.0 Request processed in 141052us (141428us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265317.448487:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 183 00000001:00080000:3.0:1789265317.448550:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967461 is committed 00000004:00080000:3.0:1789265317.448597:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000004:00080000:3.0:1789265317.448669:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:3.0:1789265317.448686:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:3.0:1789265317.448696:0:5863:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8a0f0294c300 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1789265317.448701:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a1016d11500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8a0f0294cd80 00000020:00080000:3.0:1789265317.448704:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a1016d11900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8a102ea4f800 00000020:00080000:3.0:1789265317.448933:0:5874:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1789265317.449299:0:5874:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1789265317.449323:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414308224:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789265317.449401:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265317.449502:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414308352:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789265317.449532:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265317.449588:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414308224 00000100:00100000:3.0:1789265317.449598:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414308224 00000100:00100000:3.0:1789265317.449650:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414308352 00000100:00100000:3.0:1789265317.449653:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414308352 00000100:00100000:3.0:1789265317.449681:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789265317.449692:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1876180414308224:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1789265317.449877:0:6684:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789265317.449882:0:6684:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789265317 00002000:00010000:3.0:1789265317.449885:0:6684:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789265317.449887:0:6684:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789265317 -> 1789265317 00002000:00010000:3.0:1789265317.449890:0:6684:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789265317.449936:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3318:x1876180414308224:12345-0@lo:2:osp-syn-1-0.0 Request processed in 245us (536us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1789265317.449957:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789265317.449975:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789265317.449982:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3315:x1876180414308352:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789265317.449999:0:6684:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:3.0:1789265317.450047:0:6684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa605a2, atime: 0x6aa605a2, ctime: 0x6aa605a2, blocks: 0x1 00010000:00010000:3.0:1789265317.450057:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099905208/0x27274ba5bb952ae2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.450103:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=363s v=(0 0) 00010000:00010000:3.0:1789265317.450110:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265317.450118:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099905208/0x27274ba5bb952ae2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.450138:0:6684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099905208/0x27274ba5bb952ae2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.450149:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099905208/0x27274ba5bb952ae2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.450157:0:6684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099905208/0x27274ba5bb952ae2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.450179:0:6684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789265317.450713:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3315:x1876180414308352:12345-0@lo:6:osp-syn-0-0.0 Request processed in 728us (1177us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1789265317.450722:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00010000:3.0:1789265317.450780:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265317.450789:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000099905208/0x27274ba5bb952ae2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.450800:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fae8800 already unused, calling callback (ffffffffc1581350) 00010000:00010000:3.0:1789265317.450805:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000099905208/0x27274ba5bb952ae2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.450817:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000099905208/0x27274ba5bb952ae2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.450846:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000099905208/0x27274ba5bb952ae2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.450856:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099905208/0x27274ba5bb952ae2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.450879:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265317.450881:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265317.450883:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789265317.450934:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a0f02da4000/2, rc 0, transno 4294967307 00000100:00100000:3.0:1789265317.450943:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414308352:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1789265317.450976:0:3318:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a0f02da4700/2, rc 0, transno 4294967315 00000100:00100000:3.0:1789265317.450981:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414308224:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789265317.456302:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265317.458285:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397537664 00000100:00100000:1.0:1789265317.458306:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397537664 00000100:00100000:1.0:1789265317.458405:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 55 00000100:00100000:1.0:1789265317.458419:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02df7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+10:2349:x1876180397537664:12345-192.168.203.37@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1789265317.533949:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:2.0:1789265317.533985:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:2.0:1789265317.533992:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:1.0:1789265317.534143:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02df7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+7:2349:x1876180397537664:12345-192.168.203.37@tcp:16:lhsmtool_posix.0 Request processed in 75717us (77842us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265317.534159:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 55 00000040:00080000:0.0:1789265317.537507:0:12399:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789265317.537521:0:12399:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789265317.537573:0:12399:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1789265317.537580:0:12399:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789265317.538960:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265317.539159:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397537920 00000100:00100000:3.0:1789265317.539174:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397537920 00000100:00100000:3.0:1789265317.539274:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 184 00000100:00100000:3.0:1789265317.539293:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103ba79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+18:11482:x1876180397537920:12345-192.168.203.37@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789265317.539363:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265317.539398:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7e00/0x27274ba5bb952acd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0075 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.539418:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8a1012931200) 00010000:00010000:3.0:1789265317.539423:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789265317.539538:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb952ae9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.539556:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb952ae9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.539569:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb952ae9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789265317.540251:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000086a5ce94 reply state 00000000d8596de6 transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb952ae9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265317.540268:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789265317.540418:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103ba79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+19:11482:x1876180397537920:12345-192.168.203.37@tcp:36:lhsmtool_posix.0 Request processed in 1126us (1465us total) trans 4294967462 rc 0/0 00000100:00100000:3.0:1789265317.540427:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 184 00000100:00100000:0.0:1789265317.543820:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00010000:00010000:3.0:1789265317.543902:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb952ae9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.543917:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb952ae9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.543925:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb952ae9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.543940:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fae8800 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789265317.543946:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb952ae9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.543955:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb952ae9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.543978:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8a1012931200) 00010000:00010000:3.0:1789265317.543982:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265317.543987:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb952ae9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.543994:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8800/0x27274ba5bb952ae9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265317.544037:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397538048 00000100:00100000:1.0:1789265317.544060:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397538048 00000100:00100000:1.0:1789265317.544146:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 56 00000100:00100000:1.0:1789265317.544158:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02e31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+7:2351:x1876180397538048:12345-192.168.203.37@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789265317.544486:0:6685:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1789265317.544490:0:6685:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1789265317 -> 1789265316 00002000:00010000:1.0:1789265317.544493:0:6685:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789265314 00002000:00010000:1.0:1789265317.544496:0:6685:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789265317 -> 1789265316 00002000:00010000:1.0:1789265317.544499:0:6685:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1789265317.544581:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02e31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+8:2351:x1876180397538048:12345-192.168.203.37@tcp:2:lhsmtool_posix.0 Request processed in 424us (776us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1789265317.544590:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 56 00000100:00100000:2.0:1789265317.546726:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265317.547596:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397538304 00000100:00100000:3.0:1789265317.547612:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397538304 00000100:00100000:3.0:1789265317.547720:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 185 00000100:00100000:3.0:1789265317.547732:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02df6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+18:11482:x1876180397538304:12345-192.168.203.37@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789265317.547824:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb952af0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.547844:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb952ab1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0067 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.547854:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb952af0 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.547897:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb952ab1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0067 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.547923:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb952ab1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0067 expref: 18 pid: 5840 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265317.547941:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1876180414308480:192.168.203.37@tcp:104: 00000100:00100000:3.0:1789265317.548165:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a102ec33780 going to sleep for 11 seconds 00000100:00100000:1.0:1789265317.553212:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265317.553562:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397538432 00000100:00100000:0.0:1789265317.553576:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397538432 00010000:00010000:0.0:1789265317.553636:0:8490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb952ab1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0067 expref: 19 pid: 5840 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265317.553706:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 70 00000100:00100000:0.0:1789265317.553719:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103ba78a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+19:2350:x1876180397538432:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265317.553741:0:8490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265317.553750:0:8490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb952ab1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0067 expref: 19 pid: 5840 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265317.553771:0:8490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb952ab1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0067 expref: 19 pid: 5840 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265317.553805:0:8490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8a1012931200) 00010000:00010000:0.0:1789265317.553812:0:8490:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb952af0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265317.553824:0:8490:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb952af0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265317.553833:0:8490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb952af0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265317.553857:0:8490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265317.554015:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103ba78a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+19:2350:x1876180397538432:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 297us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265317.554025:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 70 00010000:00010000:2.0:1789265317.557233:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb952ab1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0067 expref: 18 pid: 5840 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265317.557264:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1876180414308480:192.168.203.37@tcp:104: 00010000:00010000:2.0:1789265317.557302:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb952af0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.557314:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb952af0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.557321:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb952af0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.557380:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb952af0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.557389:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb952af0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.557396:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb952af0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.557404:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fae9200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789265317.557410:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb952af0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.557418:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb952af0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.557451:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8a1012931200) 00010000:00010000:2.0:1789265317.557455:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789265317.557460:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb952af0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.557467:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9200/0x27274ba5bb952af0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265317.557585:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02df6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+17:11482:x1876180397538304:12345-192.168.203.37@tcp:55:lhsmtool_posix.0 Request processed in 9853us (10866us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789265317.557597:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 185 00000100:00100000:1.0:1789265317.562821:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265317.563042:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397538560 00000100:00100000:3.0:1789265317.563057:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397538560 00000100:00100000:3.0:1789265317.563165:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 57 00000100:00100000:3.0:1789265317.563178:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103ba7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+8:2348:x1876180397538560:12345-192.168.203.37@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789265317.563453:0:8856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000099905208/0x27274ba5bb952af7 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.563481:0:8856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fa362635/0x27274ba5bb952adb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0083 expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.563491:0:8856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265317.563497:0:8856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789265317.564161:0:8856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099905208/0x27274ba5bb952af7 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.564226:0:8856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fa362635/0x27274ba5bb952adb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0083 expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.564248:0:8856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fa362635/0x27274ba5bb952adb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0083 expref: 8 pid: 6682 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265317.564288:0:8856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8856:1876180414308608:192.168.203.37@tcp:104: 00000100:00100000:3.0:1789265317.564553:0:8856:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a102ec33300 going to sleep for 11 seconds 00000100:00100000:1.0:1789265317.573206:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265317.573211:0:8856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8856:1876180414308608:192.168.203.37@tcp:104: 00010000:00010000:3.0:1789265317.573248:0:8856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000099905208/0x27274ba5bb952af7 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265317.573290:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397538688 00000100:00100000:2.0:1789265317.573300:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397538688 00010000:00010000:2.0:1789265317.573349:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fa362635/0x27274ba5bb952adb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0083 expref: 9 pid: 6682 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265317.573413:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 71 00000100:00100000:2.0:1789265317.573424:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103ba79180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+9:2350:x1876180397538688:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265317.573445:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265317.573474:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fa362635/0x27274ba5bb952adb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0083 expref: 9 pid: 6682 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.573490:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fa362635/0x27274ba5bb952adb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0083 expref: 9 pid: 6682 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.573520:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa362635/0x27274ba5bb952adb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0083 expref: 9 pid: 6682 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.573539:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789265317.573544:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789265317.573549:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000099905208/0x27274ba5bb952af7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.573560:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099905208/0x27274ba5bb952af7 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.573589:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265317.573654:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103ba79180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+8:2350:x1876180397538688:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 231us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265317.573662:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 71 00010000:00010000:2.0:1789265317.573694:0:8856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000099905208/0x27274ba5bb952af7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.573702:0:8856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099905208/0x27274ba5bb952af7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.573729:0:8856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000099905208/0x27274ba5bb952af7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.573737:0:8856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000099905208/0x27274ba5bb952af7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.573746:0:8856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000099905208/0x27274ba5bb952af7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.573754:0:8856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fae8800 already unused, calling callback (ffffffffc1581350) 00010000:00010000:2.0:1789265317.573758:0:8856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000099905208/0x27274ba5bb952af7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.573769:0:8856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000099905208/0x27274ba5bb952af7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.573782:0:8856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000099905208/0x27274ba5bb952af7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.573789:0:8856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099905208/0x27274ba5bb952af7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265317.573850:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103ba7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+7:2348:x1876180397538560:12345-192.168.203.37@tcp:1:lhsmtool_posix.0 Request processed in 10675us (11042us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265317.573859:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 57 00000100:00100000:2.0:1789265317.578617:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265317.581353:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397538944 00000100:00100000:3.0:1789265317.581375:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397538944 00000100:00100000:3.0:1789265317.581482:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 186 00000100:00100000:3.0:1789265317.581496:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02df6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+17:11482:x1876180397538944:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789265317.581610:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8400/0x27274ba5bb952afe lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.581631:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8400/0x27274ba5bb952afe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.581646:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8400/0x27274ba5bb952afe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.581916:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9c00/0x27274ba5bb952b05 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.581929:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35e00/0x27274ba5bb952abf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f006e expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.581939:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9c00/0x27274ba5bb952b05 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.582014:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35e00/0x27274ba5bb952abf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f006e expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.582035:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35e00/0x27274ba5bb952abf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f006e expref: 18 pid: 5841 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265317.582055:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da5180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1876180414308736:192.168.203.37@tcp:104: 00000100:00100000:3.0:1789265317.582214:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a102ec33300 going to sleep for 11 seconds 00000100:00100000:3.0:1789265317.589470:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da5180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1876180414308736:192.168.203.37@tcp:104: 00010000:00010000:3.0:1789265317.589513:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9c00/0x27274ba5bb952b05 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265317.592291:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265317.593195:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397539072 00000100:00100000:3.0:1789265317.593210:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397539072 00010000:00010000:3.0:1789265317.593272:0:8490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35e00/0x27274ba5bb952abf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f006e expref: 19 pid: 5841 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265317.593461:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 72 00000100:00100000:3.0:1789265317.593474:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02df7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+19:2350:x1876180397539072:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265317.593493:0:8490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265317.593502:0:8490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35e00/0x27274ba5bb952abf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f006e expref: 19 pid: 5841 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.593523:0:8490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35e00/0x27274ba5bb952abf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f006e expref: 19 pid: 5841 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.593576:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35e00/0x27274ba5bb952abf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f006e expref: 19 pid: 5841 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.593596:0:8490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8a1012931200) 00010000:00010000:3.0:1789265317.593603:0:8490:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9c00/0x27274ba5bb952b05 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.593613:0:8490:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9c00/0x27274ba5bb952b05 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.593621:0:8490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9c00/0x27274ba5bb952b05 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265317.593661:0:8490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265317.593736:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02df7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+18:2350:x1876180397539072:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 264us (1459us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265317.593745:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 72 00010000:00010000:2.0:1789265317.596566:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9c00/0x27274ba5bb952b05 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.596589:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9c00/0x27274ba5bb952b05 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789265317.596865:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:2.0:1789265317.597048:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:2.0:1789265317.597139:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:2.0:1789265317.597254:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02df5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5840:1876180414308864:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789265317.597356:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265317.597399:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a0f0294c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265317.598969:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414308864 00000100:00100000:0.0:1789265317.598988:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414308864 00000100:00100000:0.0:1789265317.599095:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789265317.599108:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02df4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5840:x1876180414308864:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789265317.599278:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02df4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5840:x1876180414308864:12345-0@lo:1000:mdt00_000.0 Request processed in 172us (1921us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265317.599285:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789265317.599299:0:5840:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:2.0:1789265317.599307:0:5840:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a0f02da4700, transno 4294967315 00000100:00100000:2.0:1789265317.599327:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02df5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5840:1876180414308864:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1789265317.601289:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:2.0:1789265317.601411:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02df5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5840:1876180414308992:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789265317.602481:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265317.602530:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1007e7ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1789265317.603496:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414308992 00000100:00100000:0.0:1789265317.603513:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414308992 00000100:00100000:0.0:1789265317.603611:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789265317.603622:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02df6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5840:x1876180414308992:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789265317.603925:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02df6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5840:x1876180414308992:12345-0@lo:1000:mdt00_000.0 Request processed in 304us (1448us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1789265317.603934:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789265317.604349:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02df5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5840:1876180414308992:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1789265317.604411:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9c00/0x27274ba5bb952b05 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.604447:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9c00/0x27274ba5bb952b05 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.604457:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9c00/0x27274ba5bb952b05 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.604464:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fae9c00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789265317.604469:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9c00/0x27274ba5bb952b05 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.604478:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9c00/0x27274ba5bb952b05 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.604498:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8a1012931200) 00010000:00010000:2.0:1789265317.604501:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789265317.604507:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9c00/0x27274ba5bb952b05 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.604512:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9c00/0x27274ba5bb952b05 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.604550:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952a3a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.604557:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952a3a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.604563:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952a3a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.604568:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad6000 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789265317.604578:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952a3a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.604584:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952a3a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.604592:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a1012931b00) 00010000:00010000:2.0:1789265317.604595:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789265317.604597:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952a3a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.604604:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952a3a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.604630:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb952b0c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.604649:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9000/0x27274ba5bb952a56 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0052 expref: 21 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.604659:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb952b0c lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.604702:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9000/0x27274ba5bb952a56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0052 expref: 21 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.604723:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9000/0x27274ba5bb952a56 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0052 expref: 21 pid: 5840 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265317.604739:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02df5500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1876180414309120:192.168.203.37@tcp:104: 00000100:00100000:2.0:1789265317.604856:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1007e7ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1789265317.610708:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265317.610979:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02df5500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1876180414309120:192.168.203.37@tcp:104: 00010000:00010000:1.0:1789265317.611027:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb952b0c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265317.612215:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397539200 00000100:00100000:2.0:1789265317.612232:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397539200 00010000:00010000:2.0:1789265317.612296:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9000/0x27274ba5bb952a56 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0052 expref: 22 pid: 5840 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265317.612349:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 73 00000100:00100000:2.0:1789265317.612362:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02e30e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+22:2351:x1876180397539200:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265317.612383:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265317.612391:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9000/0x27274ba5bb952a56 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0052 expref: 22 pid: 5840 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.612410:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9000/0x27274ba5bb952a56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0052 expref: 22 pid: 5840 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.612438:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9000/0x27274ba5bb952a56 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0052 expref: 22 pid: 5840 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.612456:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a1012931b00) 00010000:00010000:2.0:1789265317.612462:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb952b0c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.612474:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb952b0c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.612483:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb952b0c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.612519:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265317.612608:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02e30e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+21:2351:x1876180397539200:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 248us (1910us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265317.612639:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 73 00010000:00010000:1.0:1789265317.612973:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb952b0c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265317.612983:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb952b0c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265317.612998:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb952b0c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265317.613014:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb952b0c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265317.613031:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb952b0c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265317.613038:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad6c00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789265317.613043:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb952b0c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265317.613052:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb952b0c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265317.613064:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a1012931b00) 00010000:00010000:1.0:1789265317.613067:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265317.613071:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb952b0c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265317.613102:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb952b0c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265317.613114:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8400/0x27274ba5bb952afe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265317.613120:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8400/0x27274ba5bb952afe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265317.613125:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8400/0x27274ba5bb952afe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265317.613130:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fae8400 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789265317.613133:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8400/0x27274ba5bb952afe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265317.613149:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8400/0x27274ba5bb952afe lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265317.613158:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a1012931b00) 00010000:00010000:1.0:1789265317.613160:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789265317.613164:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8400/0x27274ba5bb952afe lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265317.613170:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8400/0x27274ba5bb952afe lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265317.613453:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02df6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+20:11482:x1876180397538944:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 Request processed in 31958us (34851us total) trans 4294967467 rc 0/0 00000100:00100000:1.0:1789265317.613464:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 186 00000020:00080000:1.0:1789265317.613468:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789265317.613724:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789265317.613730:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789265317.614261:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1789265317.614273:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789265317.617977:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265317.619862:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397539456 00000100:00100000:1.0:1789265317.619882:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397539456 00000100:00100000:1.0:1789265317.619955:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 50 00000100:00100000:1.0:1789265317.619968:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1010a40450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+20:11482:x1876180397539456:12345-192.168.203.37@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789265317.620865:0:5844:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789265317.620990:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967468 00010000:00010000:1.0:1789265317.621062:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb952b13 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265317.621114:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb952b13 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265317.621128:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb952b13 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265317.621150:0:5844:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb952b13 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265317.621157:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb952b13 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265317.621164:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb952b13 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265317.621193:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789265317.621338:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1010a40450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+22:11482:x1876180397539456:12345-192.168.203.37@tcp:35:lhsmtool_posix.0 Request processed in 1368us (3385us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1789265317.621349:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 50 00000020:00080000:1.0:1789265317.621355:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789265317.624809:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265317.624828:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb952b13 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.624842:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b596600 already unused, calling callback (ffffffffc1581350) 00010000:00010000:2.0:1789265317.624847:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb952b13 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.624860:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb952b13 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.625524:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8a101cdf4c00) 00010000:00010000:2.0:1789265317.625531:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789265317.625538:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb952b13 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.625547:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb952b13 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265317.625577:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265317.625579:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265317.625582:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265318.194961:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789265318.797205:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:2.0:1789265318.797239:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:2.0:1789265318.797255:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00010000:00010000:2.0:1789265319.218164:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789265319.471165:0:12451:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789265319.471174:0:12451:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789265319.471212:0:12451:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1789265319.471218:0:12451:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789265319.605131:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265319.605272:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397539712 00000100:00100000:3.0:1789265319.605283:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397539712 00000100:00100000:3.0:1789265319.605347:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 187 00000100:00100000:3.0:1789265319.605359:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02e32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+22:11501:x1876180397539712:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:3.0:1789265319.605389:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265319.605407:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb952b1a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f008a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265319.605502:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb952b21 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265319.605529:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb952b21 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265319.605540:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb952b21 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265319.605553:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1789265319.605670:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb952b1a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f008a expref: 25 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265319.605687:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb952b21 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f008a expref: 24 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265319.605697:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a101cdf4400) 00010000:00010000:3.0:1789265319.605700:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789265319.605704:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fae8e00, rc 0) 00000100:00100000:3.0:1789265319.605756:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02e32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+24:11501:x1876180397539712:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 399us (635us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1789265319.605764:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 187 00000100:00080000:0.0:1789265319.605823:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265319.613320:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265319.613400:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397539840 00000100:00100000:2.0:1789265319.613411:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397539840 00000100:00100000:2.0:1789265319.613471:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 188 00000100:00100000:2.0:1789265319.613482:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+24:11501:x1876180397539840:12345-192.168.203.37@tcp:34:lfs.0 00010000:00010000:2.0:1789265319.613559:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb952b2f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265319.613576:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb952b2f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265319.613588:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb952b2f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265319.613603:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952b36 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265319.613610:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952b36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265319.613616:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952b36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265319.613848:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb952b3d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265319.613857:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb952b3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265319.613865:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb952b3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789265319.613922:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb952b3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265319.613935:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb952b2f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265319.613952:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb952b2f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265319.613959:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb952b2f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265319.613966:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad6600 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789265319.613971:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb952b2f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265319.613979:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb952b2f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265319.614003:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a101cdf4400) 00010000:00010000:2.0:1789265319.614006:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265319.614012:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb952b2f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265319.614018:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb952b2f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265319.614031:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952b36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265319.614037:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952b36 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265319.614044:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952b36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265319.614048:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad6000 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789265319.614058:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952b36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265319.614066:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952b36 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265319.614106:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8a1012931200) 00010000:00010000:2.0:1789265319.614110:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265319.614113:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952b36 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265319.614118:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952b36 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265319.614132:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb952b3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265319.614138:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb952b3d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265319.614144:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb952b3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265319.614148:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad6c00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789265319.614150:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb952b3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265319.614155:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb952b3d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265319.614163:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a1012931e00) 00010000:00010000:2.0:1789265319.614165:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265319.614174:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb952b3d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265319.614180:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb952b3d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265319.614251:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+24:11501:x1876180397539840:12345-192.168.203.37@tcp:34:lfs.0 Request processed in 771us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265319.614260:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 188 00000100:00100000:0.0:1789265319.680828:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265319.681354:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397540096 00000100:00100000:3.0:1789265319.681364:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397540096 00000100:00100000:3.0:1789265319.681423:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 189 00000100:00100000:3.0:1789265319.681433:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02e30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+24:11504:x1876180397540096:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:3.0:1789265319.681452:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265319.681470:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb952b44 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f0091 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265319.681553:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8200/0x27274ba5bb952b4b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265319.681568:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8200/0x27274ba5bb952b4b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265319.681580:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8200/0x27274ba5bb952b4b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265319.681593:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9400/0x27274ba5bb952b52 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265319.681599:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9400/0x27274ba5bb952b52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265319.681606:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9400/0x27274ba5bb952b52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265319.682470:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb952b59 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265319.682483:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb952b59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265319.682491:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb952b59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265319.682500:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1789265319.682602:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8200/0x27274ba5bb952b4b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265319.682610:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8200/0x27274ba5bb952b4b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265319.682623:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8200/0x27274ba5bb952b4b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265319.682629:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fae8200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789265319.682633:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8200/0x27274ba5bb952b4b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265319.682640:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8200/0x27274ba5bb952b4b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265319.682652:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a101cdf4400) 00010000:00010000:3.0:1789265319.682655:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265319.682659:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8200/0x27274ba5bb952b4b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265319.682665:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8200/0x27274ba5bb952b4b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265319.682677:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9400/0x27274ba5bb952b52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265319.682683:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9400/0x27274ba5bb952b52 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265319.682689:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9400/0x27274ba5bb952b52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265319.682694:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fae9400 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789265319.682697:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9400/0x27274ba5bb952b52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265319.682725:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9400/0x27274ba5bb952b52 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265319.682737:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8a1032d00500) 00010000:00010000:3.0:1789265319.682740:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265319.682743:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9400/0x27274ba5bb952b52 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265319.682748:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9400/0x27274ba5bb952b52 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265319.682800:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb952b44 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0091 expref: 27 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265319.682814:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb952b59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0091 expref: 26 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265319.682822:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a1032d00e00) 00010000:00010000:3.0:1789265319.682824:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789265319.682827:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fae8c00, rc 0) 00000100:00100000:3.0:1789265319.683190:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02e30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+26:11504:x1876180397540096:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 1755us (2368us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1789265319.683199:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 189 00000100:00100000:2.0:1789265319.688013:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265319.688144:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397540224 00000100:00100000:0.0:1789265319.688155:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397540224 00000100:00100000:0.0:1789265319.688221:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 190 00000100:00100000:0.0:1789265319.688231:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02df4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+26:11504:x1876180397540224:12345-192.168.203.37@tcp:54:lfs.0 00010000:00010000:0.0:1789265319.688323:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35800/0x27274ba5bb952b67 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265319.688340:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35800/0x27274ba5bb952b67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265319.688352:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35800/0x27274ba5bb952b67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265319.688378:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35800/0x27274ba5bb952b67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265319.688386:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35800/0x27274ba5bb952b67 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265319.688392:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35800/0x27274ba5bb952b67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265319.688398:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fa35800 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789265319.688402:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35800/0x27274ba5bb952b67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265319.688409:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35800/0x27274ba5bb952b67 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265319.688420:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a1032d00e00) 00010000:00010000:0.0:1789265319.688423:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789265319.688428:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35800/0x27274ba5bb952b67 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265319.688434:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35800/0x27274ba5bb952b67 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265319.688511:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02df4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+26:11504:x1876180397540224:12345-192.168.203.37@tcp:54:lfs.0 Request processed in 281us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265319.688519:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 190 00000100:00100000:2.0:1789265319.694198:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265319.694371:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397540480 00000100:00100000:1.0:1789265319.694381:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397540480 00000100:00100000:1.0:1789265319.694438:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 51 00000100:00100000:1.0:1789265319.694448:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02df6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+26:11504:x1876180397540480:12345-192.168.203.37@tcp:35:lfs.0 00000100:00100000:1.0:1789265319.694746:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02df6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+27:11504:x1876180397540480:12345-192.168.203.37@tcp:35:lfs.0 Request processed in 298us (555us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1789265319.694755:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 51 00000100:00100000:2.0:1789265319.736661:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265319.736770:0:11857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397540736 00000100:00100000:3.0:1789265319.736779:0:11857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397540736 00000100:00100000:3.0:1789265319.737008:0:11857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 191 00000100:00100000:3.0:1789265319.737018:0:11857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02df4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+27:11030:x1876180397540736:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:3.0:1789265319.737057:0:11857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265319.739050:0:11857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb952b6e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f0098 expref: -99 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265319.739616:0:11857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb952b75 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265319.739635:0:11857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb952b59 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0091 expref: 28 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265319.739643:0:11857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb952b75 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265319.739681:0:11857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb952b59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0091 expref: 28 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265319.739699:0:11857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb952b59 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0091 expref: 28 pid: 5840 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265319.739735:0:11857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02df4000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11857:1876180414309248:192.168.203.37@tcp:104: 00000100:00100000:2.0:1789265319.740037:0:11857:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1007e7a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265319.747475:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265319.747600:0:11857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02df4000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11857:1876180414309248:192.168.203.37@tcp:104: 00010000:00010000:0.0:1789265319.747630:0:11857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb952b75 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265319.747762:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397540864 00000100:00100000:3.0:1789265319.747770:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397540864 00010000:00010000:3.0:1789265319.747823:0:8490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb952b59 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0091 expref: 29 pid: 5840 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265319.747862:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 74 00000100:00100000:3.0:1789265319.747872:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02df5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+29:2351:x1876180397540864:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265319.747887:0:8490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265319.747893:0:8490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb952b59 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0091 expref: 29 pid: 5840 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265319.747909:0:8490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb952b59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0091 expref: 29 pid: 5840 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265319.747933:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb952b59 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0091 expref: 29 pid: 5840 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265319.747952:0:8490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a1032d00e00) 00010000:00010000:3.0:1789265319.747957:0:8490:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb952b75 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265319.747968:0:8490:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb952b75 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265319.747976:0:8490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb952b75 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265319.748011:0:8490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265319.748121:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02df5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+28:2351:x1876180397540864:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 201us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265319.748131:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 74 00010000:00010000:0.0:1789265319.748194:0:11857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb952b75 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265319.748202:0:11857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb952b75 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265319.748221:0:11857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1789265319.748369:0:11857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9a00/0x27274ba5bb952b6e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0098 expref: 29 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265319.748385:0:11857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb952b75 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0098 expref: 28 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265319.748393:0:11857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a1032d00e00) 00010000:00010000:0.0:1789265319.748396:0:11857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789265319.748398:0:11857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fad7400, rc 0) 00000100:00100000:0.0:1789265319.748423:0:11857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02df4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+28:11030:x1876180397540736:12345-192.168.203.37@tcp:101:bash.0 Request processed in 11407us (11772us total) trans 4294967473 rc 0/0 00000100:00100000:0.0:1789265319.748430:0:11857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 191 00000100:00100000:3.0:1789265319.754523:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265319.754810:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397541120 00000100:00100000:1.0:1789265319.754821:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397541120 00000100:00100000:1.0:1789265319.754894:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 192 00000100:00100000:1.0:1789265319.754905:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+28:11030:x1876180397541120:12345-192.168.203.37@tcp:36:bash.0 00010000:00010000:1.0:1789265319.755219:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb952b83 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265319.755253:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb952b83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265319.755265:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb952b83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789265319.755321:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000004:00010000:1.0:1789265319.755349:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007b05b7ee reply state 000000004f8ab06d transno 4294967475 ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb952b83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265319.755357:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1789265319.755416:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000100:00100000:1.0:1789265319.755538:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+32:11030:x1876180397541120:12345-192.168.203.37@tcp:36:bash.0 Request processed in 634us (1025us total) trans 4294967476 rc 0/0 00000100:00100000:1.0:1789265319.755546:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 192 00000020:00080000:1.0:1789265319.755550:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1789265319.772704:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265319.772944:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397541248 00000100:00100000:0.0:1789265319.772969:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397541248 00000100:00100000:0.0:1789265319.773038:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 193 00000100:00100000:0.0:1789265319.773048:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02df4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+32:11030:x1876180397541248:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:0.0:1789265319.773089:0:7934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265319.773112:0:7934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35800/0x27274ba5bb952b8a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f009f expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265319.773168:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35800/0x27274ba5bb952b8a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f009f expref: 33 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265319.773185:0:7934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35800/0x27274ba5bb952b8a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f009f expref: 33 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265319.773203:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a1032d00e00) 00010000:00010000:0.0:1789265319.773206:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789265319.773210:0:7934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fa35800, rc 0) 00000100:00100000:0.0:1789265319.773282:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02df4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+33:11030:x1876180397541248:12345-192.168.203.37@tcp:101:bash.0 Request processed in 235us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265319.773290:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 193 00010000:00010000:3.0:1789265319.780119:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb952b83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265319.780138:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb952b83 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265319.780146:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb952b83 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265319.780152:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b597200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789265319.780157:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb952b83 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265319.780165:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb952b83 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265319.780186:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a1032d00e00) 00010000:00010000:3.0:1789265319.780189:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265319.780193:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb952b83 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265319.780198:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb952b83 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265319.784106:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265319.786536:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397541376 00000100:00100000:1.0:1789265319.786551:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397541376 00000100:00080000:3.0:1789265319.786616:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789265319.786639:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 58 00000100:00100000:1.0:1789265319.786651:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102ec5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+7:11030:x1876180397541376:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:1.0:1789265319.786671:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265319.786693:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b967bae/0x27274ba5bb952b91 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f00a6 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789265319.786722:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa605a4, atime: 0x6aa605a2, ctime: 0x6aa605a4, blocks: 0xb 00010000:00010000:1.0:1789265319.786745:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=365s v=(0 0) 00010000:00010000:1.0:1789265319.786750:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265319.786758:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b967bae/0x27274ba5bb952b91 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00a6 expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265319.786788:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002b967bae/0x27274ba5bb952b91 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00a6 expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265319.786801:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a101b597a00, rc 0) 00000100:00100000:1.0:1789265319.786870:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102ec5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+8:11030:x1876180397541376:12345-192.168.203.37@tcp:101:bash.0 Request processed in 221us (2805us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265319.786878:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 58 00000100:00100000:1.0:1789265319.792140:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265319.795350:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397541504 00000100:00100000:0.0:1789265319.795365:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397541504 00002000:00010000:0.0:1789265319.795415:0:6689:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:0.0:1789265319.795420:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a103ba7ad80 with x1876180397541504 ext(0->18446744073709551615) 00002000:00010000:0.0:1789265319.795432:0:6689:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a103ba7ad80. 00000100:00100000:0.0:1789265319.795468:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 5 00000100:00100000:0.0:1789265319.795479:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103ba7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+8:2351:x1876180397541504:12345-192.168.203.37@tcp:10:bash.0 00002000:00010000:0.0:1789265319.795752:0:6689:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1789265319.795770:0:6689:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1789265316 -> 1789265319 00002000:00010000:0.0:1789265319.795773:0:6689:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1789265314 -> 1789265314 00002000:00010000:0.0:1789265319.795775:0:6689:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789265316 -> 1789265319 00002000:00010000:0.0:1789265319.795778:0:6689:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1789265319.795857:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103ba7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+9:2351:x1876180397541504:12345-192.168.203.37@tcp:10:bash.0 Request processed in 379us (3736us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1789265319.795865:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 5 00002000:00010000:0.0:1789265319.795869:0:6689:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:0.0:1789265319.795871:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a103ba7ad80 with x1876180397541504 ext(0->18446744073709551615) 00002000:00010000:0.0:1789265319.795875:0:6689:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a103ba7ad80. 00000100:00100000:2.0:1789265319.931807:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265319.931975:0:11857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397541632 00000100:00100000:0.0:1789265319.931999:0:11857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397541632 00000100:00100000:0.0:1789265319.932138:0:11857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 194 00000100:00100000:0.0:1789265319.932150:0:11857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102ec5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+32:11518:x1876180397541632:12345-192.168.203.37@tcp:34:lfs.0 00010000:00010000:0.0:1789265319.932223:0:11857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34800/0x27274ba5bb952b98 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265319.932239:0:11857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34800/0x27274ba5bb952b98 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265319.932250:0:11857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34800/0x27274ba5bb952b98 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265319.932265:0:11857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35a00/0x27274ba5bb952b9f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265319.932273:0:11857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35a00/0x27274ba5bb952b9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265319.932279:0:11857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35a00/0x27274ba5bb952b9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265319.932520:0:11857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34e00/0x27274ba5bb952ba6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265319.932530:0:11857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34e00/0x27274ba5bb952ba6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265319.932661:0:11857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34e00/0x27274ba5bb952ba6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789265319.932703:0:11857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34e00/0x27274ba5bb952ba6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265319.932714:0:11857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34800/0x27274ba5bb952b98 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265319.932721:0:11857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34800/0x27274ba5bb952b98 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265319.932729:0:11857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34800/0x27274ba5bb952b98 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265319.932735:0:11857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fa34800 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789265319.932739:0:11857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34800/0x27274ba5bb952b98 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265319.932748:0:11857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34800/0x27274ba5bb952b98 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265319.932760:0:11857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a101cdf4400) 00010000:00010000:0.0:1789265319.932763:0:11857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265319.932768:0:11857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34800/0x27274ba5bb952b98 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265319.932781:0:11857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34800/0x27274ba5bb952b98 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265319.932793:0:11857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35a00/0x27274ba5bb952b9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265319.932799:0:11857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35a00/0x27274ba5bb952b9f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265319.932805:0:11857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35a00/0x27274ba5bb952b9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265319.932810:0:11857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fa35a00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789265319.932813:0:11857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35a00/0x27274ba5bb952b9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265319.932819:0:11857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35a00/0x27274ba5bb952b9f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265319.932826:0:11857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8a1002ca3700) 00010000:00010000:0.0:1789265319.932829:0:11857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265319.932832:0:11857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35a00/0x27274ba5bb952b9f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265319.933001:0:11857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35a00/0x27274ba5bb952b9f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265319.933017:0:11857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34e00/0x27274ba5bb952ba6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265319.933023:0:11857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34e00/0x27274ba5bb952ba6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265319.933035:0:11857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34e00/0x27274ba5bb952ba6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265319.933041:0:11857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fa34e00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789265319.933044:0:11857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34e00/0x27274ba5bb952ba6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265319.933050:0:11857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34e00/0x27274ba5bb952ba6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265319.933059:0:11857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a1032d00e00) 00010000:00010000:0.0:1789265319.933061:0:11857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265319.933064:0:11857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34e00/0x27274ba5bb952ba6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265319.933069:0:11857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34e00/0x27274ba5bb952ba6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265319.933196:0:11857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102ec5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+32:11518:x1876180397541632:12345-192.168.203.37@tcp:34:lfs.0 Request processed in 1046us (1402us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265319.933206:0:11857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 194 00000100:00100000:2.0:1789265319.993931:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265319.995974:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397541888 00000100:00100000:1.0:1789265319.996006:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397541888 00000100:00100000:1.0:1789265319.996161:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 195 00000100:00100000:1.0:1789265319.996174:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102ec5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+32:11521:x1876180397541888:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:1.0:1789265319.996202:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265319.996247:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb952bad lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f00ad expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265319.997378:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596200/0x27274ba5bb952bb4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265319.997410:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596200/0x27274ba5bb952bb4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265319.997426:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596200/0x27274ba5bb952bb4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265319.997453:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34e00/0x27274ba5bb952bbb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265319.997475:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34e00/0x27274ba5bb952bbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265319.997482:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34e00/0x27274ba5bb952bbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265319.997752:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35a00/0x27274ba5bb952bc2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265319.997762:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35a00/0x27274ba5bb952bc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265319.997770:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35a00/0x27274ba5bb952bc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265319.997781:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789265319.997880:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596200/0x27274ba5bb952bb4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265319.997889:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596200/0x27274ba5bb952bb4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265319.997897:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596200/0x27274ba5bb952bb4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265319.997903:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b596200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789265319.997908:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596200/0x27274ba5bb952bb4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265319.997916:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596200/0x27274ba5bb952bb4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265319.997938:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a101cdf4400) 00010000:00010000:0.0:1789265319.997941:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265319.997946:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596200/0x27274ba5bb952bb4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265319.997953:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596200/0x27274ba5bb952bb4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265319.997966:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34e00/0x27274ba5bb952bbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265319.997972:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34e00/0x27274ba5bb952bbb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265319.997979:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34e00/0x27274ba5bb952bbb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265319.997996:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fa34e00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789265319.997999:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34e00/0x27274ba5bb952bbb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265319.998006:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34e00/0x27274ba5bb952bbb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265319.998014:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8a1002ca3700) 00010000:00010000:0.0:1789265319.998016:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265319.998019:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34e00/0x27274ba5bb952bbb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265319.998026:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34e00/0x27274ba5bb952bbb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265319.998143:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb952bad lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00ad expref: 35 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265319.998161:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35a00/0x27274ba5bb952bc2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00ad expref: 34 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265319.998168:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a1032d00e00) 00010000:00010000:0.0:1789265319.998170:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789265319.998173:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fa35a00, rc 0) 00000100:00100000:0.0:1789265319.998606:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102ec5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+34:11521:x1876180397541888:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 2432us (4683us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1789265319.998616:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 195 00000100:00100000:3.0:1789265320.002827:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265320.005049:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397542016 00000100:00100000:2.0:1789265320.005065:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397542016 00000100:00100000:2.0:1789265320.005945:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 196 00000100:00100000:2.0:1789265320.005959:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+34:11521:x1876180397542016:12345-192.168.203.37@tcp:54:lfs.0 00010000:00010000:2.0:1789265320.006038:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952bd0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265320.006059:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb952b75 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0098 expref: 34 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265320.006069:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952bd0 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265320.006130:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb952b75 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0098 expref: 34 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265320.006145:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb952b75 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0098 expref: 34 pid: 11857 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265320.006178:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102ec5ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876180414309376:192.168.203.37@tcp:104: 00000100:00100000:2.0:1789265320.006281:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1007e7a000 going to sleep for 11 seconds 00000100:00100000:2.0:1789265320.015589:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265320.015773:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397542272 00000100:00100000:0.0:1789265320.015789:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397542272 00000100:00100000:0.0:1789265320.015865:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 52 00000100:00100000:0.0:1789265320.015876:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102ec5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+35:5586:x1876180397542272:12345-192.168.203.37@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789265320.016239:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102ec5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+36:5586:x1876180397542272:12345-192.168.203.37@tcp:35:ldlm_bl.0 Request processed in 363us (664us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1789265320.016247:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 52 00000100:00100000:3.0:1789265320.016673:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102ec5ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876180414309376:192.168.203.37@tcp:104: 00010000:00010000:3.0:1789265320.019952:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952bd0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265320.024699:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265320.024797:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397542400 00000100:00100000:1.0:1789265320.024809:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397542400 00010000:00010000:1.0:1789265320.024850:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb952b75 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0098 expref: 36 pid: 11857 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265320.024894:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 75 00000100:00100000:1.0:1789265320.024904:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10118e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+36:2350:x1876180397542400:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265320.024918:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265320.024938:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb952b75 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0098 expref: 36 pid: 11857 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265320.024953:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb952b75 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0098 expref: 36 pid: 11857 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265320.024975:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb952b75 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0098 expref: 36 pid: 11857 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265320.025003:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a1032d00e00) 00010000:00010000:1.0:1789265320.025008:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952bd0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265320.025018:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952bd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265320.025025:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952bd0 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265320.025055:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265320.025151:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10118e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+35:2350:x1876180397542400:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 248us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265320.025159:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 75 00010000:00010000:3.0:1789265320.025808:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952bd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265320.025820:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952bd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265320.025852:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952bd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265320.025859:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952bd0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265320.025866:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952bd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265320.025872:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad7a00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789265320.025877:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952bd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265320.025884:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952bd0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265320.025896:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a1032d00e00) 00010000:00010000:3.0:1789265320.025899:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789265320.025902:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952bd0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265320.025909:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952bd0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265320.025981:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+34:11521:x1876180397542016:12345-192.168.203.37@tcp:54:lfs.0 Request processed in 20025us (23162us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265320.025999:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 196 00000100:00100000:3.0:1789265320.030410:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265320.030664:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397542656 00000100:00100000:0.0:1789265320.030674:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397542656 00000100:00100000:0.0:1789265320.030774:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 53 00000100:00100000:0.0:1789265320.030784:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+34:11521:x1876180397542656:12345-192.168.203.37@tcp:35:lfs.0 00000100:00100000:0.0:1789265320.031011:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+35:11521:x1876180397542656:12345-192.168.203.37@tcp:35:lfs.0 Request processed in 228us (610us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1789265320.031034:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 53 00000100:00100000:2.0:1789265320.130043:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265320.130164:0:11857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397542912 00000100:00100000:0.0:1789265320.130176:0:11857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397542912 00000100:00100000:0.0:1789265320.130237:0:11857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 197 00000100:00100000:0.0:1789265320.130247:0:11857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102ec5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+35:11532:x1876180397542912:12345-192.168.203.37@tcp:101:cat.0 00010000:00010000:0.0:1789265320.130270:0:11857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265320.130289:0:11857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34e00/0x27274ba5bb952bd7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f00b4 expref: -99 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265320.130360:0:11857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34800/0x27274ba5bb952bde lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265320.130375:0:11857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34800/0x27274ba5bb952bde lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265320.130387:0:11857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34800/0x27274ba5bb952bde lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265320.130402:0:11857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34a00/0x27274ba5bb952be5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265320.130409:0:11857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34a00/0x27274ba5bb952be5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265320.130415:0:11857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34a00/0x27274ba5bb952be5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265320.131032:0:11857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35000/0x27274ba5bb952bec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265320.131053:0:11857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35000/0x27274ba5bb952bec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265320.131061:0:11857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35000/0x27274ba5bb952bec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265320.131072:0:11857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:0.0:1789265320.131197:0:11857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34800/0x27274ba5bb952bde lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265320.131205:0:11857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34800/0x27274ba5bb952bde lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265320.131212:0:11857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34800/0x27274ba5bb952bde lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265320.131218:0:11857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fa34800 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789265320.131222:0:11857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34800/0x27274ba5bb952bde lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265320.131230:0:11857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34800/0x27274ba5bb952bde lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265320.131242:0:11857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a101cdf4400) 00010000:00010000:0.0:1789265320.131245:0:11857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265320.131250:0:11857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34800/0x27274ba5bb952bde lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265320.131257:0:11857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34800/0x27274ba5bb952bde lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265320.131269:0:11857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34a00/0x27274ba5bb952be5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265320.131282:0:11857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34a00/0x27274ba5bb952be5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265320.131288:0:11857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34a00/0x27274ba5bb952be5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265320.131293:0:11857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fa34a00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789265320.131296:0:11857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34a00/0x27274ba5bb952be5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265320.131302:0:11857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34a00/0x27274ba5bb952be5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265320.131311:0:11857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8a1002ca3700) 00010000:00010000:0.0:1789265320.131314:0:11857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265320.131316:0:11857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34a00/0x27274ba5bb952be5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265320.131322:0:11857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34a00/0x27274ba5bb952be5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265320.131363:0:11857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34e00/0x27274ba5bb952bd7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00b4 expref: 38 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265320.131377:0:11857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35000/0x27274ba5bb952bec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00b4 expref: 37 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265320.131385:0:11857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a1032d00e00) 00010000:00010000:0.0:1789265320.131388:0:11857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789265320.131395:0:11857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fa35000, rc 0) 00000100:00100000:0.0:1789265320.131470:0:11857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102ec5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+37:11532:x1876180397542912:12345-192.168.203.37@tcp:101:cat.0 Request processed in 1223us (1436us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1789265320.131478:0:11857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 197 00000100:00100000:2.0:1789265320.149961:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265320.151666:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397543168 00000100:00100000:1.0:1789265320.151682:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397543168 00000100:00100000:1.0:1789265320.151756:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 54 00000100:00100000:1.0:1789265320.151765:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102ec5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+37:11532:x1876180397543168:12345-192.168.203.37@tcp:35:cat.0 00000100:00100000:1.0:1789265320.152019:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102ec5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+38:11532:x1876180397543168:12345-192.168.203.37@tcp:35:cat.0 Request processed in 253us (2085us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1789265320.152043:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 54 00000100:00100000:3.0:1789265320.207444:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265320.212281:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397543424 00000100:00100000:0.0:1789265320.212304:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397543424 00000100:00100000:2.0:1789265320.218283:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 198 00000100:00100000:2.0:1789265320.218305:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+38:11533:x1876180397543424:12345-192.168.203.37@tcp:36:rm.0 00010000:00010000:2.0:1789265320.218395:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789265320.218445:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35000/0x27274ba5bb952bec lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00b4 expref: 38 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265320.218473:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35a00/0x27274ba5bb952bc2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00ad expref: 37 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265320.218486:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35800/0x27274ba5bb952b8a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f009f expref: 36 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265320.218496:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a1032d00e00) 00010000:00010000:2.0:1789265320.218510:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789265320.218540:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb952bfa lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265320.218566:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb952bfa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265320.218576:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb952bfa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265320.218620:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952c01 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265320.218627:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952c01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265320.218634:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952c01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265320.219292:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952c08 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265320.219305:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952c08 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265320.219314:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952c08 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789265320.220763:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:2.0:1789265320.220781:0:5840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 366025705154ns, next at 367025700588ns, rc = 0 00010000:00010000:2.0:1789265320.222670:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952c0f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265320.222702:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952c0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265320.222717:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952c0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265320.222729:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952c0f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265320.222759:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952c0f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265320.222764:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952c0f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265320.222926:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789265320.222968:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952c08 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265320.222975:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952c08 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265320.222991:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952c08 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265320.222999:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad6000 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789265320.223004:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952c08 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265320.223012:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952c08 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265320.223026:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a1012931200) 00010000:00010000:2.0:1789265320.223030:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789265320.223034:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952c08 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265320.223040:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952c08 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265320.223071:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb952bfa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265320.223115:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb952bfa lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265320.223122:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb952bfa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265320.223127:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad6c00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789265320.223131:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb952bfa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265320.223137:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb952bfa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265320.223146:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a101cdf4400) 00010000:00010000:2.0:1789265320.223149:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265320.223152:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb952bfa lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265320.223157:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb952bfa lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789265320.223171:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004a3eeba2 reply state 00000000793910e7 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952c01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265320.223181:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789265320.223299:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+37:11533:x1876180397543424:12345-192.168.203.37@tcp:36:rm.0 Request processed in 4995us (15873us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1789265320.223309:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 198 00010000:00010000:1.0:1789265320.226483:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265320.226506:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952c0f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265320.226519:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad7a00 already unused, calling callback (ffffffffc1581350) 00010000:00010000:1.0:1789265320.226524:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952c0f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265320.226535:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952c0f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265320.226630:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a1012931200) 00010000:00010000:1.0:1789265320.226634:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789265320.226639:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952c0f lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265320.226646:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952c0f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265320.226676:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265320.226678:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265320.226680:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265320.228471:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952c01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265320.228499:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952c01 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265320.228508:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952c01 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265320.228514:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad6a00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789265320.228520:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952c01 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265320.228528:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952c01 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265320.228663:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8a1012931e00) 00010000:00010000:3.0:1789265320.228668:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265320.228674:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952c01 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265320.228685:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952c01 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265320.242321:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265320.290483:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265320.290891:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397543680 00000100:00100000:2.0:1789265320.290914:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397543680 00000100:00100000:2.0:1789265320.291180:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 199 00000100:00100000:2.0:1789265320.291193:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+36:11539:x1876180397543680:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:2.0:1789265320.291227:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265320.291267:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb952c16 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f00bb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265320.291447:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952c1d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265320.291467:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952c1d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265320.291479:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952c1d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265320.291495:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb952c24 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265320.291502:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb952c24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265320.291509:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb952c24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789265320.296140:0:5842:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:2.0:1789265320.296412:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb952c2b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265320.296446:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb952c2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265320.296477:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb952c2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265320.296530:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952c1d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265320.296538:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952c1d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265320.296546:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952c1d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265320.296553:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad6000 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789265320.296558:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952c1d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265320.296567:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952c1d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265320.296584:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a101cdf4400) 00010000:00010000:2.0:1789265320.296587:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265320.296593:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952c1d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265320.296600:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952c1d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789265320.296618:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ce571448 reply state 000000004345b747 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb952c24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265320.296630:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789265320.296689:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb952c16 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00bb expref: 39 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265320.296706:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb952c2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00bb expref: 38 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265320.296714:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a1012931000) 00010000:00010000:2.0:1789265320.296717:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789265320.296720:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fad7000, rc 0) 00000100:00100000:2.0:1789265320.296831:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+39:11539:x1876180397543680:12345-192.168.203.37@tcp:101:bash.0 Request processed in 5640us (6362us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1789265320.296841:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 199 00010000:00010000:0.0:1789265320.299869:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb952c24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265320.299895:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb952c24 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265320.299905:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb952c24 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265320.299911:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad7400 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789265320.299917:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb952c24 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265320.299926:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb952c24 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265320.299961:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8a1012931f00) 00010000:00010000:0.0:1789265320.299964:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265320.299970:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb952c24 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265320.299977:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7400/0x27274ba5bb952c24 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265320.301590:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265320.301845:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397543808 00000100:00100000:1.0:1789265320.301858:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397543808 00000100:00100000:1.0:1789265320.301943:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 59 00000100:00100000:1.0:1789265320.301953:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+5:2348:x1876180397543808:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:1.0:1789265320.301975:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265320.302009:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f4ea0eb/0x27274ba5bb952c39 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f00c2 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789265320.302065:0:6685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789265320.302433:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=366s v=(0 0) 00010000:00010000:1.0:1789265320.302439:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265320.302451:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f4ea0eb/0x27274ba5bb952c39 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00c2 expref: 6 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265320.302477:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004f4ea0eb/0x27274ba5bb952c39 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00c2 expref: 6 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265320.302493:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a101b596600, rc 0) 00000100:00100000:1.0:1789265320.302718:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:2348:x1876180397543808:12345-192.168.203.37@tcp:101:bash.0 Request processed in 757us (1132us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265320.302727:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 59 00000100:00080000:3.0:1789265320.302818:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789265320.311684:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265320.311778:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397543936 00000100:00100000:3.0:1789265320.311792:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397543936 00000100:00100000:3.0:1789265320.311867:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 60 00000100:00100000:3.0:1789265320.311879:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102ec5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:11539:x1876180397543936:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:3.0:1789265320.311903:0:8856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265320.312039:0:8856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000052e4239/0x27274ba5bb952c40 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f00c9 expref: -99 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265320.312114:0:8856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004f4ea0eb/0x27274ba5bb952c39 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00c2 expref: 7 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265320.312126:0:8856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265320.312131:0:8856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265320.312137:0:8856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000052e4239/0x27274ba5bb952c40 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00c9 expref: 7 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265320.312180:0:8856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004f4ea0eb/0x27274ba5bb952c39 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00c2 expref: 7 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265320.312200:0:8856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004f4ea0eb/0x27274ba5bb952c39 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00c2 expref: 7 pid: 6685 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265320.312218:0:8856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8856:1876180414309504:192.168.203.37@tcp:104: 00000100:00100000:3.0:1789265320.312832:0:8856:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a102ec33d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789265320.322622:0:8856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8856:1876180414309504:192.168.203.37@tcp:104: 00010000:00010000:3.0:1789265320.322675:0:8856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000052e4239/0x27274ba5bb952c40 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00c9 expref: 7 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265320.322703:0:8856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fae8c00, rc 0) 00000100:00100000:3.0:1789265320.322801:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102ec5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+7:11539:x1876180397543936:12345-192.168.203.37@tcp:101:bash.0 Request processed in 10923us (11132us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265320.322812:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 60 00000100:00100000:2.0:1789265320.326733:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265320.330165:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397544064 00000100:00100000:1.0:1789265320.330190:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397544064 00010000:00010000:1.0:1789265320.330466:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004f4ea0eb/0x27274ba5bb952c39 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00c2 expref: 7 pid: 6685 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265320.330694:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 76 00000100:00100000:1.0:1789265320.330718:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102ec5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+7:2351:x1876180397544064:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265320.330743:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265320.330774:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004f4ea0eb/0x27274ba5bb952c39 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00c2 expref: 7 pid: 6685 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265320.330822:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004f4ea0eb/0x27274ba5bb952c39 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00c2 expref: 7 pid: 6685 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265320.330853:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f4ea0eb/0x27274ba5bb952c39 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00c2 expref: 7 pid: 6685 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265320.330875:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265320.330880:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265320.330889:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000052e4239/0x27274ba5bb952c40 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00c9 expref: 6 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265320.330900:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000052e4239/0x27274ba5bb952c40 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00c9 expref: 6 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265320.333856:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000052e4239/0x27274ba5bb952c40 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00c9 expref: 6 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265320.333893:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103ba78a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5825:1876180414309632:192.168.203.37@tcp:105: 00000100:00100000:1.0:1789265320.334039:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103cd50480 going to sleep for 11 seconds 00000100:00100000:2.0:1789265320.338047:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265320.338844:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397544320 00000100:00100000:0.0:1789265320.338873:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397544320 00000100:00100000:0.0:1789265320.338999:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 55 00000100:00100000:0.0:1789265320.339011:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102ec5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+38:11539:x1876180397544320:12345-192.168.203.37@tcp:35:bash.0 00000100:00100000:0.0:1789265320.343011:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102ec5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+39:11539:x1876180397544320:12345-192.168.203.37@tcp:35:bash.0 Request processed in 1826us (2802us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1789265320.343049:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 55 00000100:00100000:1.0:1789265320.344045:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103ba78a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5825:1876180414309632:192.168.203.37@tcp:105: 00010000:00010000:1.0:1789265320.344108:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265320.344194:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102ec5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:2351:x1876180397544064:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 13488us (17476us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265320.344206:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 76 00000100:00100000:2.0:1789265320.614896:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265320.615033:0:11857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397544448 00000100:00100000:0.0:1789265320.615047:0:11857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397544448 00000100:00100000:0.0:1789265320.615172:0:11857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 200 00000100:00100000:0.0:1789265320.615184:0:11857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102ec5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+39:11555:x1876180397544448:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:0.0:1789265320.615217:0:11857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265320.615245:0:11857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34200/0x27274ba5bb952c47 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f00d0 expref: -99 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265320.615340:0:11857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35200/0x27274ba5bb952c4e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265320.615358:0:11857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35200/0x27274ba5bb952c4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265320.615372:0:11857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35200/0x27274ba5bb952c4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265320.615429:0:11857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1789265320.615434:0:11857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789265320.615457:0:11857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35200/0x27274ba5bb952c4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265320.615485:0:11857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34200/0x27274ba5bb952c47 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00d0 expref: 41 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265320.615532:0:11857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35200/0x27274ba5bb952c4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00d0 expref: 40 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265320.615542:0:11857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a101cdf4400) 00010000:00010000:0.0:1789265320.615565:0:11857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789265320.615570:0:11857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fa35200, rc 0) 00000100:00100000:0.0:1789265320.615665:0:11857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102ec5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+40:11555:x1876180397544448:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 483us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265320.615676:0:11857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 200 00000100:00100000:2.0:1789265320.633377:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265320.633755:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397544704 00000100:00100000:3.0:1789265320.633768:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397544704 00000100:00100000:3.0:1789265320.633854:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 201 00000100:00100000:3.0:1789265320.633870:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102ec5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+40:11555:x1876180397544704:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:3.0:1789265320.633896:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265320.633923:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9400/0x27274ba5bb952c55 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f00d7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265320.634508:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8200/0x27274ba5bb952c5c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265320.634532:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8200/0x27274ba5bb952c5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265320.634559:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8200/0x27274ba5bb952c5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265320.634574:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789265320.634745:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9400/0x27274ba5bb952c55 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00d7 expref: 43 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265320.634789:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8200/0x27274ba5bb952c5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00d7 expref: 42 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265320.634798:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a1012931000) 00010000:00010000:3.0:1789265320.634801:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789265320.634805:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fae8200, rc 0) 00000100:00100000:3.0:1789265320.634909:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102ec5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+42:11555:x1876180397544704:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 1044us (1546us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1789265320.634918:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 201 00000100:00100000:3.0:1789265320.638571:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265320.638624:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265320.638801:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397544832 00000100:00100000:1.0:1789265320.638815:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397544832 00000100:00100000:1.0:1789265320.638909:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 15 00000100:00100000:1.0:1789265320.638920:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+42:2351:x1876180397544832:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265320.638952:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265320.639002:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8200/0x27274ba5bb952c5c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00d7 expref: 42 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265320.639025:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a1012931000) 00010000:00010000:1.0:1789265320.639031:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265320.639136:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+41:2351:x1876180397544832:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 216us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265320.639144:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 15 00000100:00100000:0.0:1789265320.639762:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397545088 00000100:00100000:0.0:1789265320.639771:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397545088 00000100:00100000:0.0:1789265320.639827:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 202 00000100:00100000:0.0:1789265320.639836:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+41:11555:x1876180397545088:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:0.0:1789265320.639872:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265320.639893:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35c00/0x27274ba5bb952c6a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f00de expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265320.640036:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34400/0x27274ba5bb952c71 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265320.640052:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34400/0x27274ba5bb952c71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265320.640066:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34400/0x27274ba5bb952c71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265320.640113:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789265320.640677:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35c00/0x27274ba5bb952c6a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00de expref: 44 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265320.640701:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34400/0x27274ba5bb952c71 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00de expref: 43 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265320.640710:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a1012931000) 00010000:00010000:0.0:1789265320.640713:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789265320.640717:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fa34400, rc 0) 00000100:00100000:0.0:1789265320.640782:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+43:11555:x1876180397545088:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 946us (2155us total) trans 4294967486 rc 0/0 00000100:00100000:0.0:1789265320.640790:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 202 00000100:00100000:0.0:1789265320.656244:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265320.668674:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397545216 00000100:00100000:1.0:1789265320.668701:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397545216 00000100:00100000:1.0:1789265320.668807:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 61 00000100:00100000:1.0:1789265320.668819:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02e30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+6:2350:x1876180397545216:12345-192.168.203.37@tcp:1:lfs.0 00010000:00010000:1.0:1789265320.668884:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f4ea0eb/0x27274ba5bb952c7f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265320.668905:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000052e4239/0x27274ba5bb952c40 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00c9 expref: 6 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265320.668914:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265320.668917:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789265320.668921:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f4ea0eb/0x27274ba5bb952c7f lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265320.668993:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000052e4239/0x27274ba5bb952c40 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00c9 expref: 6 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265320.669015:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000052e4239/0x27274ba5bb952c40 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00c9 expref: 6 pid: 8856 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265320.669033:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103ba78a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6682:1876180414309760:192.168.203.37@tcp:104: 00000100:00100000:1.0:1789265320.669403:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103cd50480 going to sleep for 11 seconds 00000100:00100000:1.0:1789265320.671802:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103ba78a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6682:1876180414309760:192.168.203.37@tcp:104: 00010000:00010000:1.0:1789265320.671842:0:6682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004f4ea0eb/0x27274ba5bb952c7f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265320.673271:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265320.674020:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397545344 00000100:00100000:2.0:1789265320.674038:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397545344 00002000:00100000:2.0:1789265320.674160:0:6690:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8a0f02e31f80 x1876180397545344/t0(0) o4->4b820fcb-1bab-4b78-bfa4-355c22a09cf8@192.168.203.37@tcp:646/0 lens 504/0 e 0 to 0 dl 1789265331 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789265320.674173:0:6690:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a0f02e31f80 with x1876180397545344 ext(0->8) 00010000:00010000:2.0:1789265320.674186:0:6690:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000052e4239/0x27274ba5bb952c40 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00c9 expref: 7 pid: 8856 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265320.674211:0:6690:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000052e4239/0x27274ba5bb952c40 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00c9 expref: 7 pid: 8856 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789265320.674247:0:6690:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8a0f02e31f80 00000100:00100000:2.0:1789265320.674281:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 3 00000100:00100000:2.0:1789265320.674292:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02e31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+7:2350:x1876180397545344:12345-192.168.203.37@tcp:4:lfs.0 00000100:00100000:2.0:1789265320.675412:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02e31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+9:2350:x1876180397545344:12345-192.168.203.37@tcp:4:lfs.0 Request processed in 1112us (2143us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789265320.675436:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 3 00002000:00100000:2.0:1789265320.675446:0:6690:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8a0f02e31f80 x1876180397545344/t4294967308(0) o4->4b820fcb-1bab-4b78-bfa4-355c22a09cf8@192.168.203.37@tcp:646/0 lens 504/448 e 0 to 0 dl 1789265331 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789265320.675457:0:6690:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a0f02e31f80 with x1876180397545344 ext(0->8) 00010000:00010000:2.0:1789265320.675466:0:6690:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000052e4239/0x27274ba5bb952c40 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00c9 expref: 9 pid: 8856 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265320.675484:0:6690:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000052e4239/0x27274ba5bb952c40 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00c9 expref: 9 pid: 8856 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789265320.675491:0:6690:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8a0f02e31f80 00000100:00100000:2.0:1789265320.683444:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265320.683531:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397545472 00000100:00100000:3.0:1789265320.683545:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397545472 00010000:00010000:3.0:1789265320.683603:0:8490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000052e4239/0x27274ba5bb952c40 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00c9 expref: 9 pid: 8856 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265320.683658:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 77 00000100:00100000:3.0:1789265320.683671:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102ec5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+9:2351:x1876180397545472:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265320.683690:0:8490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789265320.683718:0:8490:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789265320.683721:0:8490:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789265320 00002000:00010000:3.0:1789265320.683723:0:8490:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789265320 00002000:00010000:3.0:1789265320.683726:0:8490:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1789265320 00010000:00010000:3.0:1789265320.683733:0:8490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000052e4239/0x27274ba5bb952c40 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00c9 expref: 9 pid: 8856 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265320.683777:0:8490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000052e4239/0x27274ba5bb952c40 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00c9 expref: 9 pid: 8856 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265320.683808:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000052e4239/0x27274ba5bb952c40 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00c9 expref: 9 pid: 8856 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265320.683830:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789265320.683836:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789265320.683843:0:8490:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004f4ea0eb/0x27274ba5bb952c7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265320.683854:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f4ea0eb/0x27274ba5bb952c7f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265320.683901:0:8490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265320.683989:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102ec5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+8:2351:x1876180397545472:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 311us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265320.683998:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 77 00010000:00010000:2.0:1789265320.685209:0:6682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004f4ea0eb/0x27274ba5bb952c7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265320.685230:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f4ea0eb/0x27274ba5bb952c7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265320.685282:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f4ea0eb/0x27274ba5bb952c7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265320.685309:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f4ea0eb/0x27274ba5bb952c7f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265320.685319:0:6682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f4ea0eb/0x27274ba5bb952c7f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265320.685326:0:6682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b596600 already unused, calling callback (ffffffffc1581350) 00010000:00010000:2.0:1789265320.685332:0:6682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f4ea0eb/0x27274ba5bb952c7f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265320.685342:0:6682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f4ea0eb/0x27274ba5bb952c7f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265320.685363:0:6682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f4ea0eb/0x27274ba5bb952c7f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265320.685371:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f4ea0eb/0x27274ba5bb952c7f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265320.685481:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02e30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+7:2350:x1876180397545216:12345-192.168.203.37@tcp:1:lfs.0 Request processed in 16661us (29248us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265320.685493:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 61 00000100:00100000:2.0:1789265320.695323:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265320.695819:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397545728 00000100:00100000:3.0:1789265320.695831:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397545728 00000100:00100000:3.0:1789265320.695915:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 56 00000100:00100000:3.0:1789265320.695927:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1010a43850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+43:11555:x1876180397545728:12345-192.168.203.37@tcp:35:lfs.0 00000004:00010000:3.0:1789265320.696024:0:5843:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34400/0x27274ba5bb952c71 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00de expref: 43 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789265320.696403:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:3.0:1789265320.696452:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:3.0:1789265320.696831:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00010000:00010000:3.0:1789265320.696893:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb952c86 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265320.696912:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb952c2b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00bb expref: 47 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265320.696922:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb952c86 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265320.696968:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb952c2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00bb expref: 47 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265320.697000:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb952c2b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00bb expref: 47 pid: 5842 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265320.697020:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da6a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5843:1876180414309888:192.168.203.37@tcp:104: 00000100:00100000:3.0:1789265320.697180:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a102ec33f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789265320.699299:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da6a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5843:1876180414309888:192.168.203.37@tcp:104: 00010000:00010000:3.0:1789265320.699338:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb952c86 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265320.700765:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265320.701004:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397545856 00000100:00100000:1.0:1789265320.701018:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397545856 00010000:00010000:1.0:1789265320.701118:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb952c2b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00bb expref: 48 pid: 5842 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265320.701165:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 78 00000100:00100000:1.0:1789265320.701177:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102ec5df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+48:2350:x1876180397545856:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265320.701198:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265320.701206:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb952c2b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00bb expref: 48 pid: 5842 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265320.701225:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb952c2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00bb expref: 48 pid: 5842 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265320.701273:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb952c2b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00bb expref: 48 pid: 5842 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265320.701290:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a1012931000) 00010000:00010000:1.0:1789265320.701296:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb952c86 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265320.701306:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb952c86 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265320.701313:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb952c86 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265320.701343:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265320.701411:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102ec5df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+47:2350:x1876180397545856:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 235us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265320.701431:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 78 00010000:00010000:0.0:1789265320.701627:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb952c86 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265320.701637:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb952c86 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789265320.701809:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:0.0:1789265320.702121:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:0.0:1789265320.702285:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02e30a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5843:1876180414310016:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789265320.702361:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265320.702402:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103bb47d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789265320.702634:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414310016 00000100:00100000:1.0:1789265320.702643:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414310016 00000100:00100000:1.0:1789265320.702711:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789265320.702722:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02e33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5843:x1876180414310016:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789265320.702813:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02e33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5843:x1876180414310016:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 92us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265320.702820:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1789265320.702846:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265320.703298:0:5843:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:0.0:1789265320.703306:0:5843:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:0.0:1789265320.703328:0:5843:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a0f02da4000, transno 4294967307 00000100:00100000:0.0:1789265320.703345:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02e30a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5843:1876180414310016:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1789265320.704992:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:0.0:1789265320.705671:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02e30a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5843:1876180414310144:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789265320.705760:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265320.705804:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103bb47300 going to sleep for 11 seconds 00000100:00100000:1.0:1789265320.705873:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414310144 00000100:00100000:1.0:1789265320.705883:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414310144 00000100:00100000:1.0:1789265320.705987:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789265320.706010:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02e31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5843:x1876180414310144:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789265320.706283:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02e31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5843:x1876180414310144:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 274us (522us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1789265320.706292:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789265320.706392:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02e30a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5843:1876180414310144:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789265320.706492:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:2.0:1789265320.706548:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb952c86 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265320.706560:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb952c86 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265320.706569:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb952c86 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265320.706577:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fae8c00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789265320.706583:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb952c86 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265320.706591:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb952c86 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265320.706611:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a1012931000) 00010000:00010000:2.0:1789265320.706615:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789265320.706620:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb952c86 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265320.706627:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb952c86 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789265320.706843:0:5843:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789265320.706946:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:2.0:1789265320.706959:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 366511883397ns, next at 367511881094ns, rc = 0 00000001:00080000:2.0:1789265320.706966:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:2.0:1789265320.707011:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a1012931000) 00010000:00010000:2.0:1789265320.707015:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789265320.707029:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34400/0x27274ba5bb952c71 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00de expref: 51 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265320.707192:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1010a43850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+50:11555:x1876180397545728:12345-192.168.203.37@tcp:35:lfs.0 Request processed in 11266us (11884us total) trans 4294967495 rc 0/0 00000100:00100000:2.0:1789265320.707201:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 56 00000020:00080000:2.0:1789265320.707206:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789265320.713620:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265320.713711:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397545984 00000100:00100000:0.0:1789265320.713726:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397545984 00000100:00100000:0.0:1789265320.713799:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 203 00000100:00100000:0.0:1789265320.713809:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102ec5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+50:11555:x1876180397545984:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:0.0:1789265320.713842:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265320.713871:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34c00/0x27274ba5bb952c8d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f00e5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265320.713952:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34c00/0x27274ba5bb952c8d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00e5 expref: 51 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265320.713968:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34c00/0x27274ba5bb952c8d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00e5 expref: 51 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265320.713999:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a1002ca3700) 00010000:00010000:0.0:1789265320.714003:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789265320.714007:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fa34c00, rc 0) 00000100:00100000:0.0:1789265320.714113:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102ec5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+51:11555:x1876180397545984:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 268us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265320.714122:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 203 00000100:00100000:3.0:1789265320.717872:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265320.720043:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397546240 00000100:00100000:0.0:1789265320.720064:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397546240 00000100:00100000:0.0:1789265320.720175:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 57 00000100:00100000:0.0:1789265320.720208:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+51:11555:x1876180397546240:12345-192.168.203.37@tcp:35:lfs.0 00000100:00100000:0.0:1789265320.722222:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+52:11555:x1876180397546240:12345-192.168.203.37@tcp:35:lfs.0 Request processed in 2000us (4360us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1789265320.722241:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 57 00000100:00100000:1.0:1789265320.758966:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414310272:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789265320.759155:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265320.760131:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414310272 00000100:00100000:2.0:1789265320.760145:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414310272 00000100:00100000:2.0:1789265320.760217:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789265320.760230:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103ba78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1876180414310272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789265320.760267:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789265320.760362:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103ba78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1876180414310272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 134us (1207us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265320.760370:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789265320.760453:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414310272:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789265320.781235:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265320.781327:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397546368 00000100:00100000:3.0:1789265320.781341:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397546368 00000100:00100000:3.0:1789265320.781423:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 204 00000100:00100000:3.0:1789265320.781433:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102ec5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+52:11565:x1876180397546368:12345-192.168.203.37@tcp:34:lfs.0 00010000:00010000:3.0:1789265320.781532:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9400/0x27274ba5bb952c94 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265320.781554:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9400/0x27274ba5bb952c94 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265320.781568:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9400/0x27274ba5bb952c94 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265320.781598:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb952c9b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265320.781606:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb952c9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265320.781613:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb952c9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265320.781720:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8200/0x27274ba5bb952ca2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265320.781728:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8200/0x27274ba5bb952ca2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265320.781736:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8200/0x27274ba5bb952ca2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789265320.781788:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8200/0x27274ba5bb952ca2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265320.781806:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9400/0x27274ba5bb952c94 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265320.781820:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9400/0x27274ba5bb952c94 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265320.781827:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9400/0x27274ba5bb952c94 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265320.781834:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fae9400 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789265320.781839:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9400/0x27274ba5bb952c94 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265320.781857:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9400/0x27274ba5bb952c94 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265320.781873:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a101cdf4400) 00010000:00010000:3.0:1789265320.781876:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265320.781881:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9400/0x27274ba5bb952c94 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265320.781888:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9400/0x27274ba5bb952c94 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265320.781904:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb952c9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265320.781910:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb952c9b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265320.781915:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb952c9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265320.781921:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fae8c00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789265320.781930:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb952c9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265320.781937:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb952c9b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265320.781945:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8a1032d00500) 00010000:00010000:3.0:1789265320.781948:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265320.781950:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb952c9b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265320.781956:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8c00/0x27274ba5bb952c9b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265320.781971:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8200/0x27274ba5bb952ca2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265320.781975:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8200/0x27274ba5bb952ca2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265320.782012:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8200/0x27274ba5bb952ca2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265320.782018:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fae8200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789265320.782021:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8200/0x27274ba5bb952ca2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265320.782027:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8200/0x27274ba5bb952ca2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265320.782034:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a1002ca3700) 00010000:00010000:3.0:1789265320.782036:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265320.782048:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8200/0x27274ba5bb952ca2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265320.782054:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8200/0x27274ba5bb952ca2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265320.782214:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102ec5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+52:11565:x1876180397546368:12345-192.168.203.37@tcp:34:lfs.0 Request processed in 780us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265320.782224:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 204 00000100:00100000:2.0:1789265320.848370:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265320.848546:0:11857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397546624 00000100:00100000:1.0:1789265320.848560:0:11857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397546624 00000100:00100000:1.0:1789265320.848643:0:11857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 205 00000100:00100000:1.0:1789265320.848657:0:11857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102ec5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+52:11568:x1876180397546624:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:1.0:1789265320.848684:0:11857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265320.848708:0:11857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb952ca9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f00ec expref: -99 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265320.848809:0:11857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb952cb0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265320.848831:0:11857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb952cb0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265320.848844:0:11857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb952cb0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265320.848862:0:11857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb952cb7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265320.848871:0:11857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb952cb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265320.848896:0:11857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb952cb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265320.851405:0:11857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596e00/0x27274ba5bb952cbe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265320.851656:0:11857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596e00/0x27274ba5bb952cbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265320.851674:0:11857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596e00/0x27274ba5bb952cbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265320.851693:0:11857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1789265320.854582:0:11857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb952cb0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265320.854618:0:11857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb952cb0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265320.854627:0:11857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb952cb0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265320.854635:0:11857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b597c00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789265320.854641:0:11857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb952cb0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265320.854651:0:11857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb952cb0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265320.854675:0:11857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a101cdf4400) 00010000:00010000:1.0:1789265320.854678:0:11857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265320.854714:0:11857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb952cb0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265320.854721:0:11857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb952cb0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265320.854742:0:11857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb952cb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265320.854749:0:11857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb952cb7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265320.854755:0:11857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb952cb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265320.854762:0:11857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b596600 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789265320.854764:0:11857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb952cb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265320.854770:0:11857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb952cb7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265320.854779:0:11857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8a101cdf4800) 00010000:00010000:1.0:1789265320.854782:0:11857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265320.854785:0:11857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb952cb7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265320.854791:0:11857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb952cb7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265320.854886:0:11857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb952ca9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00ec expref: 55 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265320.854916:0:11857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596e00/0x27274ba5bb952cbe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00ec expref: 54 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265320.854925:0:11857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a1002ca3700) 00010000:00010000:1.0:1789265320.854928:0:11857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789265320.854930:0:11857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a101b596e00, rc 0) 00000100:00100000:1.0:1789265320.855068:0:11857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102ec5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+54:11568:x1876180397546624:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 6413us (6710us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1789265320.855128:0:11857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 205 00000100:00100000:2.0:1789265320.860339:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265320.860461:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397546752 00000100:00100000:0.0:1789265320.860477:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397546752 00000100:00100000:0.0:1789265320.860553:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 206 00000100:00100000:0.0:1789265320.860576:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102ec5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+54:11568:x1876180397546752:12345-192.168.203.37@tcp:54:lfs.0 00010000:00010000:0.0:1789265320.860683:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34400/0x27274ba5bb952ccc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265320.860706:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34400/0x27274ba5bb952ccc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265320.860720:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34400/0x27274ba5bb952ccc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265320.860761:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34400/0x27274ba5bb952ccc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265320.860768:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34400/0x27274ba5bb952ccc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265320.860777:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34400/0x27274ba5bb952ccc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265320.860784:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fa34400 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789265320.860790:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34400/0x27274ba5bb952ccc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265320.860825:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34400/0x27274ba5bb952ccc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265320.861047:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a1002ca3700) 00010000:00010000:0.0:1789265320.861052:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789265320.861059:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34400/0x27274ba5bb952ccc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265320.861066:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34400/0x27274ba5bb952ccc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265320.861198:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102ec5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+54:11568:x1876180397546752:12345-192.168.203.37@tcp:54:lfs.0 Request processed in 624us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265320.861207:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 206 00000100:00100000:2.0:1789265320.866482:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265320.869723:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397547008 00000100:00100000:0.0:1789265320.869745:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397547008 00000100:00100000:0.0:1789265320.869931:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 58 00000100:00100000:0.0:1789265320.869946:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102ec5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+54:11568:x1876180397547008:12345-192.168.203.37@tcp:35:lfs.0 00000100:00100000:0.0:1789265320.870520:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102ec5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+55:11568:x1876180397547008:12345-192.168.203.37@tcp:35:lfs.0 Request processed in 576us (4052us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1789265320.870531:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 58 00000100:00100000:2.0:1789265320.992865:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265320.993016:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397547264 00000100:00100000:0.0:1789265320.993031:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397547264 00000100:00100000:0.0:1789265320.993213:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 207 00000100:00100000:0.0:1789265320.993228:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102ec5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+55:11578:x1876180397547264:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:0.0:1789265320.993259:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265320.993264:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789265320.993321:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35200/0x27274ba5bb952c4e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00d0 expref: 55 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265320.993347:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a101cdf4400) 00010000:00010000:0.0:1789265320.993353:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789265320.993370:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34400/0x27274ba5bb952cd3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f00f3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265320.994185:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35400/0x27274ba5bb952cda lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265320.994205:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35400/0x27274ba5bb952cda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265320.994218:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35400/0x27274ba5bb952cda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265320.994231:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789265320.994402:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34400/0x27274ba5bb952cd3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00f3 expref: 57 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265320.995071:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35400/0x27274ba5bb952cda lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00f3 expref: 56 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265320.995117:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a1002ca3700) 00010000:00010000:0.0:1789265320.995121:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789265320.995124:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fa35400, rc 0) 00000100:00100000:0.0:1789265320.995280:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102ec5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+56:11578:x1876180397547264:12345-192.168.203.37@tcp:101:bash.0 Request processed in 2054us (2429us total) trans 4294967499 rc 0/0 00000100:00100000:0.0:1789265320.995290:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 207 00000100:00100000:2.0:1789265321.002307:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265321.002898:0:11857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397547520 00000100:00100000:1.0:1789265321.002914:0:11857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397547520 00000100:00100000:1.0:1789265321.003329:0:11857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 208 00000100:00100000:1.0:1789265321.003343:0:11857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102ec5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+56:11578:x1876180397547520:12345-192.168.203.37@tcp:36:bash.0 00010000:00010000:1.0:1789265321.003431:0:11857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789265321.003467:0:11857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35400/0x27274ba5bb952cda lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00f3 expref: 56 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265321.003493:0:11857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596e00/0x27274ba5bb952cbe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00ec expref: 55 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265321.003505:0:11857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a1002ca3700) 00010000:00010000:1.0:1789265321.003512:0:11857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789265321.004352:0:11857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb952ce8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265321.004373:0:11857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb952ce8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265321.004405:0:11857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb952ce8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789265321.004737:0:11857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967500 00000004:00010000:1.0:1789265321.004774:0:11857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b366590a reply state 00000000c3f045c1 transno 4294967501 ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb952ce8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265321.004784:0:11857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789265321.005015:0:11857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102ec5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+57:11578:x1876180397547520:12345-192.168.203.37@tcp:36:bash.0 Request processed in 1671us (2718us total) trans 4294967501 rc 0/0 00000100:00100000:1.0:1789265321.005026:0:11857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 208 00000020:00080000:1.0:1789265321.005032:0:11857:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:3.0:1789265321.005483:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265321.008930:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265321.009034:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397547648 00000100:00100000:0.0:1789265321.009049:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397547648 00000100:00100000:0.0:1789265321.009155:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 209 00000100:00100000:0.0:1789265321.009167:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102ec5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+57:11578:x1876180397547648:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:0.0:1789265321.009198:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265321.009226:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34400/0x27274ba5bb952cef lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f00fa expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.009339:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35200/0x27274ba5bb952cf6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.009357:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb952ce8 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.009365:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35200/0x27274ba5bb952cf6 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.009388:0:5841:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb952ce8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.009402:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35200/0x27274ba5bb952cf6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265321.011218:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb952ce8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265321.011242:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb952ce8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265321.011251:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb952ce8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265321.011258:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b597800 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789265321.011263:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb952ce8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265321.011272:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb952ce8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265321.011295:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a1002ca3700) 00010000:00010000:3.0:1789265321.011301:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265321.011304:0:3301:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35200/0x27274ba5bb952cf6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265321.011315:0:3301:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35200/0x27274ba5bb952cf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265321.011346:0:3301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35200/0x27274ba5bb952cf6 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265321.011444:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb952ce8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265321.011452:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb952ce8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.011551:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35200/0x27274ba5bb952cf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.011561:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35200/0x27274ba5bb952cf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265321.011737:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789265321.011742:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789265321.011783:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35200/0x27274ba5bb952cf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.011835:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34400/0x27274ba5bb952cef lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00fa expref: 58 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.011928:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35200/0x27274ba5bb952cf6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00fa expref: 57 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.011938:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a1002ca3700) 00010000:00010000:0.0:1789265321.011941:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789265321.011944:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fa35200, rc 0) 00000100:00100000:0.0:1789265321.012211:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102ec5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+57:11578:x1876180397547648:12345-192.168.203.37@tcp:101:bash.0 Request processed in 3043us (3293us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265321.012222:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 209 00000100:00100000:2.0:1789265321.016451:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265321.016943:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397547904 00000100:00100000:1.0:1789265321.016959:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397547904 00000100:00100000:1.0:1789265321.017124:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 59 00000100:00100000:1.0:1789265321.017138:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102eb09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+57:11578:x1876180397547904:12345-192.168.203.37@tcp:35:bash.0 00000100:00100000:1.0:1789265321.017751:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102eb09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+58:11578:x1876180397547904:12345-192.168.203.37@tcp:35:bash.0 Request processed in 613us (1311us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1789265321.017762:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 59 00000100:00100000:2.0:1789265321.116362:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265321.123989:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397548032 00000100:00100000:0.0:1789265321.124014:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397548032 00000100:00100000:0.0:1789265321.124232:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 210 00000100:00100000:0.0:1789265321.124247:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102eb08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+58:11584:x1876180397548032:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:0.0:1789265321.124294:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265321.124323:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34400/0x27274ba5bb952cfd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f0101 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.124425:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34000/0x27274ba5bb952d04 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.124452:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34000/0x27274ba5bb952d04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.124466:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34000/0x27274ba5bb952d04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265321.124531:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1789265321.124536:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789265321.124580:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34000/0x27274ba5bb952d04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.124611:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34400/0x27274ba5bb952cfd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0101 expref: 60 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.124636:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34000/0x27274ba5bb952d04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0101 expref: 59 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.124646:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a101cdf4400) 00010000:00010000:0.0:1789265321.124649:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789265321.124654:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fa34000, rc 0) 00000100:00100000:0.0:1789265321.124759:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102eb08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+59:11584:x1876180397548032:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 516us (8925us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265321.124767:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 210 00000100:00100000:2.0:1789265321.132231:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265321.132690:0:11857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397548160 00000100:00100000:1.0:1789265321.132704:0:11857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397548160 00000100:00100000:1.0:1789265321.132781:0:11857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 211 00000100:00100000:1.0:1789265321.132793:0:11857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102eb0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+59:11584:x1876180397548160:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:1.0:1789265321.132820:0:11857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265321.132857:0:11857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596e00/0x27274ba5bb952d0b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f0108 expref: -99 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265321.134251:0:11857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb952d12 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265321.134271:0:11857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb952d12 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265321.134286:0:11857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb952d12 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265321.134304:0:11857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb952d19 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265321.134311:0:11857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb952d19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265321.134317:0:11857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb952d19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265321.134446:0:11857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb952d20 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265321.134455:0:11857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb952d20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265321.134462:0:11857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb952d20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265321.134508:0:11857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1789265321.134514:0:11857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789265321.134539:0:11857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb952d20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265321.136232:0:11857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb952d20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265321.136261:0:11857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb952d12 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265321.136270:0:11857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb952d12 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265321.136278:0:11857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb952d12 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265321.136285:0:11857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b596600 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789265321.136290:0:11857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb952d12 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265321.136299:0:11857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb952d12 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265321.136318:0:11857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a101cdf4400) 00010000:00010000:1.0:1789265321.136321:0:11857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265321.136328:0:11857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb952d12 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265321.136335:0:11857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb952d12 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265321.136355:0:11857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb952d19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265321.136362:0:11857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb952d19 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265321.136390:0:11857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb952d19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265321.136396:0:11857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b597c00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789265321.136399:0:11857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb952d19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265321.136405:0:11857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb952d19 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265321.136526:0:11857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8a101cdf4800) 00010000:00010000:1.0:1789265321.136529:0:11857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265321.136532:0:11857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb952d19 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265321.136538:0:11857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb952d19 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265321.136684:0:11857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596e00/0x27274ba5bb952d0b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0108 expref: 61 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265321.136703:0:11857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb952d20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0108 expref: 60 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265321.136712:0:11857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a1002ca3700) 00010000:00010000:1.0:1789265321.136714:0:11857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789265321.136718:0:11857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a101b597200, rc 0) 00000100:00100000:1.0:1789265321.136833:0:11857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102eb0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+60:11584:x1876180397548160:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 4040us (4764us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265321.137750:0:11857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 211 00000100:00100000:2.0:1789265321.147282:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265321.147465:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265321.149755:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397548288 00000100:00100000:3.0:1789265321.149778:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397548288 00000100:00100000:3.0:1789265321.149916:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 16 00000100:00100000:3.0:1789265321.149929:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102eb08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+60:2350:x1876180397548288:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265321.149949:0:8490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265321.149993:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb952d20 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0108 expref: 60 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265321.150018:0:8490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a1002ca3700) 00010000:00010000:3.0:1789265321.150024:0:8490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265321.150147:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102eb08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+59:2350:x1876180397548288:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 220us (2681us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265321.150155:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 16 00000100:00100000:0.0:1789265321.150357:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397548544 00000100:00100000:0.0:1789265321.150364:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397548544 00000100:00100000:0.0:1789265321.150503:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 212 00000100:00100000:0.0:1789265321.150512:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102eb08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+59:11584:x1876180397548544:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:0.0:1789265321.150534:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265321.150561:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34400/0x27274ba5bb952d27 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f010f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.150705:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35e00/0x27274ba5bb952d2e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.150744:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35200/0x27274ba5bb952cf6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00fa expref: 60 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.150754:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35e00/0x27274ba5bb952d2e lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.150797:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35200/0x27274ba5bb952cf6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00fa expref: 60 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.150818:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35200/0x27274ba5bb952cf6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00fa expref: 60 pid: 5841 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265321.150845:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02e31880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1876180414310400:192.168.203.37@tcp:104: 00000100:00100000:0.0:1789265321.150962:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103bb47240 going to sleep for 11 seconds 00000100:00100000:0.0:1789265321.156664:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02e31880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1876180414310400:192.168.203.37@tcp:104: 00010000:00010000:0.0:1789265321.156702:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35e00/0x27274ba5bb952d2e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265321.157660:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265321.158131:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397548672 00000100:00100000:1.0:1789265321.158147:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397548672 00010000:00010000:1.0:1789265321.158209:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35200/0x27274ba5bb952cf6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00fa expref: 61 pid: 5841 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265321.158304:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 79 00000100:00100000:1.0:1789265321.158317:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102eb09f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+61:2351:x1876180397548672:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265321.158337:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265321.158345:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35200/0x27274ba5bb952cf6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00fa expref: 61 pid: 5841 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265321.158363:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35200/0x27274ba5bb952cf6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00fa expref: 61 pid: 5841 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265321.158393:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35200/0x27274ba5bb952cf6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00fa expref: 61 pid: 5841 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265321.158414:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a1002ca3700) 00010000:00010000:1.0:1789265321.158428:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35e00/0x27274ba5bb952d2e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265321.158446:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35e00/0x27274ba5bb952d2e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265321.158455:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35e00/0x27274ba5bb952d2e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265321.158506:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265321.158590:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102eb09f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+60:2351:x1876180397548672:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 275us (2160us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265321.158599:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 79 00010000:00010000:0.0:1789265321.159398:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35e00/0x27274ba5bb952d2e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.159413:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35e00/0x27274ba5bb952d2e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265321.159446:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789265321.159669:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34400/0x27274ba5bb952d27 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f010f expref: 61 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.159713:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35e00/0x27274ba5bb952d2e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f010f expref: 60 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.159722:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a1002ca3700) 00010000:00010000:0.0:1789265321.159725:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789265321.159728:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fa35e00, rc 0) 00000100:00100000:0.0:1789265321.159805:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102eb08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+60:11584:x1876180397548544:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 9293us (12537us total) trans 4294967503 rc 0/0 00000100:00100000:0.0:1789265321.159815:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 212 00000100:00100000:2.0:1789265321.178890:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265321.179298:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397548928 00000100:00100000:3.0:1789265321.179312:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397548928 00000100:00100000:3.0:1789265321.179401:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 17 00000100:00100000:3.0:1789265321.179423:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10118e5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+60:11584:x1876180397548928:12345-192.168.203.37@tcp:103:lfs.0 00010000:00010000:3.0:1789265321.179451:0:8490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265321.179500:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34c00/0x27274ba5bb952c8d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00e5 expref: 60 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265321.179524:0:8490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a1002ca3700) 00010000:00010000:3.0:1789265321.179530:0:8490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265321.179620:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10118e5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+59:11584:x1876180397548928:12345-192.168.203.37@tcp:103:lfs.0 Request processed in 209us (1749us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265321.179628:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 17 00000100:00100000:2.0:1789265321.184916:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265321.187258:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397549056 00000100:00100000:0.0:1789265321.187284:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397549056 00000100:00100000:0.0:1789265321.187459:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 213 00000100:00100000:0.0:1789265321.187474:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102eb08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+59:11584:x1876180397549056:12345-192.168.203.37@tcp:58:lfs.0 00010000:00010000:0.0:1789265321.187664:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34400/0x27274ba5bb952d3c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.187688:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34400/0x27274ba5bb952d3c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.187701:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34400/0x27274ba5bb952d3c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789265321.190206:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1789265321.190373:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102eb08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+59:11584:x1876180397549056:12345-192.168.203.37@tcp:58:lfs.0 Request processed in 2895us (5469us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265321.190389:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 213 00000100:00100000:3.0:1789265321.196372:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265321.196584:0:11857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397549184 00000100:00100000:1.0:1789265321.196598:0:11857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397549184 00000100:00100000:1.0:1789265321.196675:0:11857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 214 00000100:00100000:1.0:1789265321.196686:0:11857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+59:11584:x1876180397549184:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:1.0:1789265321.196717:0:11857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265321.196745:0:11857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596e00/0x27274ba5bb952d43 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f0116 expref: -99 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265321.196826:0:11857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34400/0x27274ba5bb952d3c lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265321.196839:0:11857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596e00/0x27274ba5bb952d43 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0116 expref: 60 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265321.196865:0:11857:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34400/0x27274ba5bb952d3c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265321.197055:0:11857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596e00/0x27274ba5bb952d43 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0116 expref: 60 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265321.197072:0:11857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a1002ca3700) 00010000:00010000:1.0:1789265321.197127:0:11857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789265321.197132:0:11857:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596e00/0x27274ba5bb952d43 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0116 expref: 60 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265321.197161:0:11857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a101b596e00, rc 0) 00000100:00100000:1.0:1789265321.197241:0:11857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+60:11584:x1876180397549184:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 555us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265321.197248:0:11857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 214 00010000:00010000:1.0:1789265321.270587:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789265321.714483:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789265321.714497:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789265321.714551:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1789265321.714559:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789265321.714732:0:11671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102eb0b800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11671:1876180414310528:192.168.203.37@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789265321.714896:0:11671:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1007e7ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1789265321.719854:0:11671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102eb0b800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11671:1876180414310528:192.168.203.37@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789265321.724950:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265321.726692:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397549312 00000100:00100000:2.0:1789265321.726714:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397549312 00000100:00100000:2.0:1789265321.726819:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 215 00000100:00100000:2.0:1789265321.726832:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02e31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+60:11585:x1876180397549312:12345-192.168.203.37@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789265321.726883:0:5841:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789265321.727054:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02e31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+60:11585:x1876180397549312:12345-192.168.203.37@tcp:53:lhsmtool_posix.0 Request processed in 224us (2129us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265321.727064:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 215 00000100:00100000:3.0:1789265321.735305:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265321.735633:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397549440 00000100:00100000:0.0:1789265321.735648:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397549440 00000100:00100000:0.0:1789265321.735756:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 216 00000100:00100000:0.0:1789265321.735771:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+60:11585:x1876180397549440:12345-192.168.203.37@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789265321.735891:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34200/0x27274ba5bb952d4a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.735915:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34200/0x27274ba5bb952d4a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.736173:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34200/0x27274ba5bb952d4a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.736200:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34800/0x27274ba5bb952d51 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.736209:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34800/0x27274ba5bb952d51 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.736294:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34800/0x27274ba5bb952d51 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.736323:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34a00/0x27274ba5bb952d58 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.736332:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34a00/0x27274ba5bb952d58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.736338:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34a00/0x27274ba5bb952d58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265321.736393:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789265321.736424:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789265321.736443:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34a00/0x27274ba5bb952d58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.736457:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34200/0x27274ba5bb952d4a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.736464:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34200/0x27274ba5bb952d4a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.736472:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34200/0x27274ba5bb952d4a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.736478:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fa34200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789265321.736483:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34200/0x27274ba5bb952d4a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.736491:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34200/0x27274ba5bb952d4a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.736506:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a1032d00f00) 00010000:00010000:0.0:1789265321.736510:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265321.736515:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34200/0x27274ba5bb952d4a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.736521:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34200/0x27274ba5bb952d4a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.736539:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34800/0x27274ba5bb952d51 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.736545:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34800/0x27274ba5bb952d51 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.736561:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34800/0x27274ba5bb952d51 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.736567:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fa34800 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789265321.736570:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34800/0x27274ba5bb952d51 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.736577:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34800/0x27274ba5bb952d51 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.736586:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff8a1002ca3200) 00010000:00010000:0.0:1789265321.736589:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265321.736592:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34800/0x27274ba5bb952d51 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.736597:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34800/0x27274ba5bb952d51 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.736614:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34a00/0x27274ba5bb952d58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.736621:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34a00/0x27274ba5bb952d58 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.736627:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34a00/0x27274ba5bb952d58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.736632:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fa34a00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789265321.736635:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34a00/0x27274ba5bb952d58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.736652:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34a00/0x27274ba5bb952d58 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.736660:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a1002ca3700) 00010000:00010000:0.0:1789265321.736663:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265321.736666:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34a00/0x27274ba5bb952d58 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.736671:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34a00/0x27274ba5bb952d58 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265321.738633:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+60:11585:x1876180397549440:12345-192.168.203.37@tcp:34:lhsmtool_posix.0 Request processed in 2848us (3326us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265321.738651:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 216 00000100:00100000:3.0:1789265321.741909:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265321.742745:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397549696 00000100:00100000:2.0:1789265321.742762:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397549696 00000100:00100000:2.0:1789265321.743049:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 217 00000100:00100000:2.0:1789265321.743064:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+60:11585:x1876180397549696:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789265321.743109:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265321.743140:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952d5f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f011d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265321.743329:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb952d66 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265321.743351:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb952d66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265321.743376:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb952d66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265321.743393:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789265321.743548:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb952d66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265321.743557:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb952d66 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265321.743565:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb952d66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265321.743573:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad6c00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789265321.743578:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb952d66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265321.743587:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb952d66 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265321.743603:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a1002ca3700) 00010000:00010000:2.0:1789265321.743606:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789265321.743610:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb952d66 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265321.743629:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb952d66 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265321.743686:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952d5f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f011d expref: 62 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265321.743698:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a1032d00f00) 00010000:00010000:2.0:1789265321.743701:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789265321.743705:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6000/0x27274ba5bb952d5f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f011d expref: 62 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265321.743715:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fad6000, rc 0) 00000100:00100000:2.0:1789265321.743814:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+61:11585:x1876180397549696:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 753us (1921us total) trans 4294967504 rc 301/301 00000100:00100000:2.0:1789265321.743823:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 217 00000100:00100000:2.0:1789265321.750191:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265321.750621:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397549824 00000100:00100000:0.0:1789265321.750635:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397549824 00000100:00100000:0.0:1789265321.750773:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 218 00000100:00100000:0.0:1789265321.750788:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102eb0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+61:11585:x1876180397549824:12345-192.168.203.37@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789265321.750848:0:7934:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789265321.751023:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102eb0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+61:11585:x1876180397549824:12345-192.168.203.37@tcp:53:lhsmtool_posix.0 Request processed in 239us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265321.751032:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 218 00000100:00100000:2.0:1789265321.757573:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265321.758962:0:11857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397550080 00000100:00100000:1.0:1789265321.759089:0:11857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397550080 00000100:00100000:0.0:1789265321.759619:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 219 00000100:00100000:0.0:1789265321.759636:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102eb09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+61:11585:x1876180397550080:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789265321.759666:0:7934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265321.759669:0:7934:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789265321.759837:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34000/0x27274ba5bb952d04 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0101 expref: 61 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.759918:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a101cdf4400) 00010000:00010000:0.0:1789265321.759924:0:7934:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789265321.760526:0:7934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34a00/0x27274ba5bb952d74 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f0124 expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789265321.761680:0:7934:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:0.0:1789265321.762141:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34800/0x27274ba5bb952d7b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.762161:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34800/0x27274ba5bb952d7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.762177:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34800/0x27274ba5bb952d7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.762264:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34a00/0x27274ba5bb952d74 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0124 expref: 63 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.762286:0:7934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34800/0x27274ba5bb952d7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0124 expref: 62 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.762297:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8a1002ca3200) 00010000:00010000:0.0:1789265321.762301:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789265321.762305:0:7934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fa34800, rc 0) 00000100:00100000:0.0:1789265321.762553:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102eb09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+62:11585:x1876180397550080:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 2920us (4994us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1789265321.762585:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 219 00000100:00100000:3.0:1789265321.767691:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265321.768264:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397550336 00000100:00100000:2.0:1789265321.768280:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397550336 00000100:00100000:2.0:1789265321.768360:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 220 00000100:00100000:2.0:1789265321.768379:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+62:11585:x1876180397550336:12345-192.168.203.37@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789265321.768467:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265321.768509:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34800/0x27274ba5bb952d7b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0124 expref: 62 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265321.768537:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8a1002ca3200) 00010000:00010000:2.0:1789265321.768572:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789265321.768601:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb952d89 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265321.768620:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb952d89 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265321.768632:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb952d89 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265321.769154:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb952d90 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xc88aea5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265321.769181:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb952d90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xc88aea5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265321.769194:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb952d90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xc88aea5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265321.769272:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb952d89 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265321.769279:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb952d89 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265321.769287:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb952d89 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265321.769293:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad6c00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789265321.769298:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb952d89 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265321.769306:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb952d89 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265321.769333:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a101cdf4400) 00010000:00010000:2.0:1789265321.769336:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265321.769341:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb952d89 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265321.769348:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb952d89 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265321.769361:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb952d90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xc88aea5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265321.769368:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb952d90 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc88aea5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265321.769374:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb952d90 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc88aea5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265321.769380:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad7000 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789265321.769383:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb952d90 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc88aea5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265321.769389:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb952d90 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc88aea5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265321.772735:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xc88aea5 (ffff8a1012931000) 00010000:00010000:2.0:1789265321.772741:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265321.772750:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb952d90 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xc88aea5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265321.772758:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7000/0x27274ba5bb952d90 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xc88aea5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265321.772905:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+61:11585:x1876180397550336:12345-192.168.203.37@tcp:36:lhsmtool_posix.0 Request processed in 4530us (5226us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789265321.772914:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 220 00000100:00100000:2.0:1789265321.777261:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265321.777550:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397550464 00000100:00100000:0.0:1789265321.777565:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397550464 00000100:00100000:0.0:1789265321.777648:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 221 00000100:00100000:0.0:1789265321.777661:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102eb09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+61:11585:x1876180397550464:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789265321.777692:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265321.777732:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34a00/0x27274ba5bb952d97 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f012b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.777784:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34200/0x27274ba5bb952d9e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.777803:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34200/0x27274ba5bb952d9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.777819:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34200/0x27274ba5bb952d9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.778003:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34a00/0x27274ba5bb952d97 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f012b expref: 63 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.778027:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34200/0x27274ba5bb952d9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f012b expref: 62 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.778038:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8a1002ca3000) 00010000:00010000:0.0:1789265321.778041:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789265321.778045:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fa34200, rc 0) 00000100:00100000:0.0:1789265321.778161:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102eb09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+62:11585:x1876180397550464:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 502us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265321.778180:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 221 00000100:00100000:0.0:1789265321.779782:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02e32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1876180414310912:0@lo:400:kworker.0 00000100:00100000:0.0:1789265321.779884:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265321.780043:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02e33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:871daf34-1206-40e7-bd71-78303abe4d37:3317:1876180414310656:0@lo:400:kworker.0 00000100:00100000:2.0:1789265321.780119:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265321.780359:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414310912 00000100:00100000:3.0:1789265321.780369:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414310912 00000100:00100000:3.0:1789265321.780464:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789265321.780475:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103f98ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876180414310912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265321.780545:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103f98ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876180414310912:12345-0@lo:400:kworker.0 Request processed in 72us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265321.780553:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00080000:2.0:1789265321.780690:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265321.780766:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02e33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876180414310784:0@lo:400:kworker.0 00000100:00100000:1.0:1789265321.780806:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265321.780855:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414310656 00000100:00100000:1.0:1789265321.780860:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414310656 00000100:00100000:1.0:1789265321.780901:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1789265321.780909:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+19:3317:x1876180414310656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265321.780961:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+19:3317:x1876180414310656:12345-0@lo:400:kworker.0 Request processed in 53us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265321.780968:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1789265321.781020:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02e32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414311040:0@lo:400:kworker.0 00000100:00100000:1.0:1789265321.781052:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265321.781114:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414311040 00000100:00100000:1.0:1789265321.781118:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414311040 00000100:00100000:1.0:1789265321.781149:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789265321.781156:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103ba79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3316:x1876180414311040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265321.781192:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103ba79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3316:x1876180414311040:12345-0@lo:400:kworker.0 Request processed in 37us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265321.781198:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789265321.781402:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414310784 00000100:00100000:2.0:1789265321.781419:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414310784 00000100:00100000:2.0:1789265321.781454:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789265321.781462:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103ba79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876180414310784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265321.781504:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103ba79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876180414310784:12345-0@lo:400:kworker.0 Request processed in 43us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265321.781511:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789265321.782169:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02e33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:871daf34-1206-40e7-bd71-78303abe4d37:3317:1876180414310656:0@lo:400:kworker.0 00000100:00100000:1.0:1789265321.782183:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02e33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1876180414311168:0@lo:400:kworker.0 00000100:00100000:1.0:1789265321.782617:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265321.782712:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02e32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1876180414310912:0@lo:400:kworker.0 00000100:00100000:2.0:1789265321.782806:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414311168 00000100:00100000:2.0:1789265321.782814:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414311168 00000100:00100000:2.0:1789265321.782886:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789265321.782895:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103ba7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1876180414311168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265321.782960:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103ba7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1876180414311168:12345-0@lo:400:kworker.0 Request processed in 66us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265321.782967:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:3.0:1789265321.783164:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265321.783260:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02e33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876180414310784:0@lo:400:kworker.0 00000100:00100000:0.0:1789265321.783272:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02e30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414311296:0@lo:400:kworker.0 00000100:00100000:0.0:1789265321.783338:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265321.783523:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414311296 00000100:00100000:3.0:1789265321.783529:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414311296 00000100:00100000:3.0:1789265321.783582:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789265321.783590:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102eecce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3318:x1876180414311296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265321.783635:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102eecce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3318:x1876180414311296:12345-0@lo:400:kworker.0 Request processed in 46us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265321.783642:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789265321.783733:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02e33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1876180414311168:0@lo:400:kworker.0 00000100:00100000:2.0:1789265321.783835:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02e32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414311040:0@lo:400:kworker.0 00000100:00080000:0.0:1789265321.784459:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789265321.784494:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02e30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414311296:0@lo:400:kworker.0 00000100:00100000:0.0:1789265321.787881:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265321.788415:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397550720 00000100:00100000:3.0:1789265321.788431:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397550720 00000100:00100000:3.0:1789265321.788516:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 222 00000100:00100000:3.0:1789265321.788529:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102eece680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+62:11585:x1876180397550720:12345-192.168.203.37@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789265321.788654:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8200/0x27274ba5bb952da5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265321.788676:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8200/0x27274ba5bb952da5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265321.788691:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8200/0x27274ba5bb952da5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789265321.791183:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:3.0:1789265321.791666:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 367596589962ns, next at 368596126473ns, rc = 0 00000004:00010000:3.0:1789265321.791850:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e836f953 reply state 00000000271d1410 transno 4294967506 ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8200/0x27274ba5bb952da5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265321.791864:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789265321.793737:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102eece680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+64:11585:x1876180397550720:12345-192.168.203.37@tcp:36:lhsmtool_posix.0 Request processed in 4867us (5527us total) trans 4294967506 rc 0/0 00000100:00100000:3.0:1789265321.793755:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 222 00010000:00010000:0.0:1789265321.795186:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8200/0x27274ba5bb952da5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.795214:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8200/0x27274ba5bb952da5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.795224:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8200/0x27274ba5bb952da5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.795232:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fae8200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789265321.795238:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8200/0x27274ba5bb952da5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.795247:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8200/0x27274ba5bb952da5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.795268:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8a1002ca3000) 00010000:00010000:0.0:1789265321.795272:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789265321.795296:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8200/0x27274ba5bb952da5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.795303:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8200/0x27274ba5bb952da5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265321.797182:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265321.797754:0:11857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397550848 00000100:00100000:1.0:1789265321.797768:0:11857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397550848 00000100:00100000:1.0:1789265321.797855:0:11857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 223 00000100:00100000:1.0:1789265321.797868:0:11857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102eecc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+63:11585:x1876180397550848:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789265321.797903:0:11857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265321.797942:0:11857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb952dac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f0132 expref: -99 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265321.798037:0:11857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb952dac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0132 expref: 64 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265321.798057:0:11857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb952dac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0132 expref: 64 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265321.798113:0:11857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8a1002ca3000) 00010000:00010000:1.0:1789265321.798117:0:11857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789265321.798122:0:11857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a101b597c00, rc 0) 00000100:00100000:1.0:1789265321.798198:0:11857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102eecc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+64:11585:x1876180397550848:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 334us (1033us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265321.798331:0:11857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 223 00000100:00100000:3.0:1789265321.801624:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265321.802359:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397550976 00000100:00100000:2.0:1789265321.802374:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397550976 00000100:00100000:2.0:1789265321.802552:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 62 00000100:00100000:2.0:1789265321.802583:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+9:2350:x1876180397550976:12345-192.168.203.37@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789265321.803151:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+10:2350:x1876180397550976:12345-192.168.203.37@tcp:2:lhsmtool_posix.0 Request processed in 570us (1539us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1789265321.803162:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 62 00000100:00080000:0.0:1789265321.804490:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789265321.806965:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265321.807274:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397551232 00000100:00100000:2.0:1789265321.807287:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397551232 00000100:00100000:2.0:1789265321.807363:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 60 00000100:00100000:2.0:1789265321.807376:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102eecc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+64:11585:x1876180397551232:12345-192.168.203.37@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789265321.807823:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102eecc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+65:11585:x1876180397551232:12345-192.168.203.37@tcp:35:lhsmtool_posix.0 Request processed in 448us (869us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1789265321.807833:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 60 00000100:00100000:3.0:1789265321.811120:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265321.811460:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397551488 00000100:00100000:1.0:1789265321.811474:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397551488 00000100:00100000:1.0:1789265321.811549:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 224 00000100:00100000:1.0:1789265321.811560:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+65:11585:x1876180397551488:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789265321.811756:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+65:11585:x1876180397551488:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 Request processed in 198us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265321.811765:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 224 00000100:00100000:3.0:1789265321.815051:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265321.815281:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397551616 00000100:00100000:0.0:1789265321.815294:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397551616 00000100:00100000:0.0:1789265321.815404:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 225 00000100:00100000:0.0:1789265321.815427:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102ec5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+65:11585:x1876180397551616:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789265321.815453:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265321.815478:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34e00/0x27274ba5bb952db3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f0139 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.815592:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35800/0x27274ba5bb952dba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.815610:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35800/0x27274ba5bb952dba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.815624:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35800/0x27274ba5bb952dba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265321.815670:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789265321.815695:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35800/0x27274ba5bb952dba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.815729:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34e00/0x27274ba5bb952db3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0139 expref: 67 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.815761:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35800/0x27274ba5bb952dba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0139 expref: 66 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.815769:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8a1002ca3000) 00010000:00010000:0.0:1789265321.815772:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789265321.815776:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fa35800, rc 0) 00000100:00100000:0.0:1789265321.815867:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102ec5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+66:11585:x1876180397551616:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 444us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265321.815876:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 225 00000100:00100000:2.0:1789265321.818995:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265321.819166:0:12007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397551744 00000100:00100000:3.0:1789265321.819179:0:12007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397551744 00000100:00100000:3.0:1789265321.819261:0:12007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 63 00000100:00100000:3.0:1789265321.819273:0:12007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102eb0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+10:2351:x1876180397551744:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789265321.819317:0:12007:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265321.819345:0:12007:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000052e4239/0x27274ba5bb952dc1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f0140 expref: -99 pid: 12007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789265321.819380:0:12007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa605a9, blocks: 0x1 00010000:00010000:3.0:1789265321.819416:0:12007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=367s v=(0 0) 00010000:00010000:3.0:1789265321.819422:0:12007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265321.819435:0:12007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000052e4239/0x27274ba5bb952dc1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0140 expref: 11 pid: 12007 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265321.819457:0:12007:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000052e4239/0x27274ba5bb952dc1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0140 expref: 11 pid: 12007 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265321.819473:0:12007:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fae8c00, rc 0) 00000100:00100000:3.0:1789265321.819546:0:12007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102eb0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+11:2351:x1876180397551744:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 275us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265321.819554:0:12007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 63 00000100:00100000:3.0:1789265321.822746:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265321.824045:0:11857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397552000 00000100:00100000:1.0:1789265321.824063:0:11857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397552000 00000100:00100000:1.0:1789265321.824180:0:11857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 226 00000100:00100000:1.0:1789265321.824192:0:11857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102ec5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+66:11585:x1876180397552000:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789265321.824367:0:11857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102ec5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+66:11585:x1876180397552000:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 Request processed in 177us (1633us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265321.824376:0:11857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 226 00000100:00100000:3.0:1789265321.827876:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265321.828571:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397552128 00000100:00100000:1.0:1789265321.828589:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397552128 00000100:00100000:1.0:1789265321.828672:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 64 00000100:00100000:1.0:1789265321.828685:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102ec5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+11:11585:x1876180397552128:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789265321.828712:0:6684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265321.828740:0:6684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1451423/0x27274ba5bb952dc8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f0147 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265321.828787:0:6684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000052e4239/0x27274ba5bb952dc1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0140 expref: 12 pid: 12007 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265321.828798:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265321.828822:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265321.828829:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1451423/0x27274ba5bb952dc8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0147 expref: 12 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265321.829024:0:6684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000052e4239/0x27274ba5bb952dc1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0140 expref: 12 pid: 12007 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265321.829045:0:6684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000052e4239/0x27274ba5bb952dc1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0140 expref: 12 pid: 12007 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265321.829062:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103ba7a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6684:1876180414311424:192.168.203.37@tcp:104: 00000100:00100000:1.0:1789265321.829416:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a101b530480 going to sleep for 11 seconds 00000100:00100000:0.0:1789265321.836915:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265321.837278:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397552256 00000100:00100000:3.0:1789265321.837291:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397552256 00010000:00010000:3.0:1789265321.837356:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000052e4239/0x27274ba5bb952dc1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0140 expref: 13 pid: 12007 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265321.837427:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 80 00000100:00100000:3.0:1789265321.837442:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102eecdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+13:2350:x1876180397552256:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265321.837484:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265321.837514:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000052e4239/0x27274ba5bb952dc1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0140 expref: 13 pid: 12007 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265321.837535:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000052e4239/0x27274ba5bb952dc1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0140 expref: 13 pid: 12007 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265321.837570:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265321.837575:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265321.837586:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f1451423/0x27274ba5bb952dc8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0147 expref: 13 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265321.837599:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1451423/0x27274ba5bb952dc8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0147 expref: 13 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265321.837675:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f1451423/0x27274ba5bb952dc8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0147 expref: 13 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265321.837693:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103fc41f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5826:1876180414311552:192.168.203.37@tcp:105: 00000100:00100000:3.0:1789265321.837807:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a102ec33d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789265321.841470:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103fc41f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5826:1876180414311552:192.168.203.37@tcp:105: 00010000:00010000:3.0:1789265321.841512:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265321.841597:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102eecdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+13:2350:x1876180397552256:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 4156us (4698us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265321.841610:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 80 00010000:00010000:1.0:1789265321.843558:0:6684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000052e4239/0x27274ba5bb952dc1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0140 expref: 12 pid: 12007 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265321.843596:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103ba7a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6684:1876180414311424:192.168.203.37@tcp:104: 00010000:00010000:1.0:1789265321.843639:0:6684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f1451423/0x27274ba5bb952dc8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0147 expref: 11 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265321.843658:0:6684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a101b596200, rc 0) 00000100:00100000:1.0:1789265321.843756:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102ec5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+11:11585:x1876180397552128:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 15071us (15893us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265321.843766:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 64 00000100:00100000:2.0:1789265321.848299:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265321.848554:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397552384 00000100:00100000:3.0:1789265321.848570:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397552384 00002000:00100000:3.0:1789265321.848642:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff8a102eb0b100 x1876180397552384/t0(0) o4->4b820fcb-1bab-4b78-bfa4-355c22a09cf8@192.168.203.37@tcp:647/0 lens 504/0 e 0 to 0 dl 1789265332 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789265321.848656:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a102eb0b100 with x1876180397552384 ext(0->12) 00002000:00010000:3.0:1789265321.848663:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a102eb0b100 00000100:00100000:3.0:1789265321.848761:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 6 00000100:00100000:3.0:1789265321.848773:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102eb0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+11:2349:x1876180397552384:12345-192.168.203.37@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789265321.849491:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102eb0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+13:2349:x1876180397552384:12345-192.168.203.37@tcp:4:lhsmtool_posix.0 Request processed in 716us (1204us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1789265321.849502:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 6 00002000:00100000:3.0:1789265321.849512:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff8a102eb0b100 x1876180397552384/t4294967320(0) o4->4b820fcb-1bab-4b78-bfa4-355c22a09cf8@192.168.203.37@tcp:647/0 lens 504/448 e 0 to 0 dl 1789265332 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789265321.849522:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a102eb0b100 with x1876180397552384 ext(0->12) 00002000:00010000:3.0:1789265321.849528:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a102eb0b100 00000100:00100000:0.0:1789265321.853829:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265321.854281:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397552512 00000100:00100000:2.0:1789265321.854296:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397552512 00000100:00100000:2.0:1789265321.854401:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 227 00000100:00100000:2.0:1789265321.854481:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102eecca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+66:11585:x1876180397552512:12345-192.168.203.37@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789265321.911308:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000020:00080000:3.0:1789265321.911349:0:5863:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8a103bb47d80 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1789265321.911356:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a102e973800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8a103bb47600 00000020:00080000:3.0:1789265321.911360:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a102e973500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8a103fa5d400 00000020:00080000:3.0:1789265321.911414:0:5874:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:00080000:3.0:1789265321.911481:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967507 is committed 00000004:00080000:3.0:1789265321.911497:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000004:00080000:3.0:1789265321.911514:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:3.0:1789265321.911526:0:5863:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8a0f0294ccc0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1789265321.911529:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a1012a48300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8a0f0294c0c0 00000020:00080000:3.0:1789265321.911553:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a1012a48a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8a0f03712c00 00000004:00080000:3.0:1789265321.911571:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000020:00080000:3.0:1789265321.911600:0:5863:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:3.0:1789265321.911610:0:5874:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000100:00100000:2.0:1789265321.912343:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102eb0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414311808:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789265321.912446:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265321.912522:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789265321.912529:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102eb0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414311680:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789265321.912556:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265321.912595:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414311808 00000100:00100000:2.0:1789265321.912604:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414311808 00000100:00100000:2.0:1789265321.912656:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414311680 00000100:00100000:2.0:1789265321.912671:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414311680 00000100:00100000:2.0:1789265321.912701:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789265321.912711:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1016dd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3316:x1876180414311808:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1789265321.912918:0:6685:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789265321.912923:0:6685:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1789265322 00000020:00080000:3.0:1789265321.913373:0:5874:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00002000:00010000:2.0:1789265321.913520:0:6685:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789265321.913525:0:6685:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1789265321 -> 1789265322 00002000:00010000:2.0:1789265321.913528:0:6685:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789265321.913614:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1016dd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3316:x1876180414311808:12345-0@lo:2:osp-syn-1-0.0 Request processed in 901us (1166us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1789265321.913624:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789265321.913828:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789265321.914177:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102eb0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3316:x1876180414311680:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789265321.914285:0:6685:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:2.0:1789265321.914314:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df92b299/0x27274ba5bb952dcf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265321.914343:0:6685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002b967bae/0x27274ba5bb952b91 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00a6 expref: 12 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265321.914353:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1789265321.914358:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789265321.914364:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df92b299/0x27274ba5bb952dcf lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789265321.914554:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a102eb0ad80/2, rc 0, transno 4294967321 00000100:00100000:3.0:1789265321.914564:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102eb0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414311808:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1789265321.914605:0:6685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002b967bae/0x27274ba5bb952b91 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00a6 expref: 12 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265321.914652:0:6685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002b967bae/0x27274ba5bb952b91 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00a6 expref: 12 pid: 6682 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265321.914670:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102eb0bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6685:1876180414311936:192.168.203.37@tcp:104: 00000100:00100000:2.0:1789265321.915031:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10107f23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265321.915302:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789265321.915318:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102eecf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414312064:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789265321.915372:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265321.915660:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414312064 00000100:00100000:1.0:1789265321.915670:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414312064 00000100:00100000:1.0:1789265321.915727:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789265321.915751:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102eecd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3318:x1876180414312064:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789265321.915781:0:6684:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:1.0:1789265321.915817:0:6684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa605a8, atime: 0x6aa605a8, ctime: 0x6aa605a8, blocks: 0x1 00010000:00010000:1.0:1789265321.915826:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041791934/0x27274ba5bb952dd6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265321.915852:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=367s v=(0 0) 00010000:00010000:1.0:1789265321.915857:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265321.915864:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000041791934/0x27274ba5bb952dd6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265321.915883:0:6684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000041791934/0x27274ba5bb952dd6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265321.915893:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041791934/0x27274ba5bb952dd6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265321.915902:0:6684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000041791934/0x27274ba5bb952dd6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265321.916142:0:6684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789265321.917429:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265321.917443:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000041791934/0x27274ba5bb952dd6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.917457:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b597800 already unused, calling callback (ffffffffc1581350) 00010000:00010000:0.0:1789265321.917463:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000041791934/0x27274ba5bb952dd6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.917475:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000041791934/0x27274ba5bb952dd6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.917518:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000041791934/0x27274ba5bb952dd6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.917527:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000041791934/0x27274ba5bb952dd6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.917553:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265321.917556:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265321.917558:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265321.917616:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102eecd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3318:x1876180414312064:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1863us (2238us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1789265321.917628:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789265321.917766:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102eecca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+20:11585:x1876180397552512:12345-192.168.203.37@tcp:44:lhsmtool_posix.0 Request processed in 63289us (63950us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265321.917776:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 227 00000004:00080000:2.0:1789265321.918223:0:3318:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a102eecf800/2, rc 0, transno 4294967310 00000100:00100000:2.0:1789265321.918232:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102eecf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414312064:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789265321.922772:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265321.922912:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265321.923175:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102eb0bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6685:1876180414311936:192.168.203.37@tcp:104: 00010000:00010000:3.0:1789265321.923222:0:6685:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000df92b299/0x27274ba5bb952dcf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265321.923388:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397552768 00000100:00100000:0.0:1789265321.923397:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397552768 00010000:00010000:0.0:1789265321.923458:0:8490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002b967bae/0x27274ba5bb952b91 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00a6 expref: 13 pid: 6682 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265321.923496:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 81 00000100:00100000:0.0:1789265321.923508:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103ba78700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+13:2350:x1876180397552768:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265321.923527:0:8490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265321.923534:0:8490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002b967bae/0x27274ba5bb952b91 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00a6 expref: 13 pid: 6682 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.923553:0:8490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002b967bae/0x27274ba5bb952b91 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00a6 expref: 13 pid: 6682 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.923585:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b967bae/0x27274ba5bb952b91 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f00a6 expref: 13 pid: 6682 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.923628:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789265321.923633:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789265321.923639:0:8490:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000df92b299/0x27274ba5bb952dcf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.923649:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df92b299/0x27274ba5bb952dcf lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265321.923684:0:8490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265321.923754:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103ba78700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+12:2350:x1876180397552768:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 248us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265321.923762:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 81 00010000:00010000:3.0:1789265321.924459:0:6685:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000df92b299/0x27274ba5bb952dcf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265321.924475:0:6685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df92b299/0x27274ba5bb952dcf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265321.924487:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df92b299/0x27274ba5bb952dcf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265321.924496:0:6685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000df92b299/0x27274ba5bb952dcf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265321.924516:0:6685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789265321.925719:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102eb0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3316:x1876180414311680:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11873us (13151us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1789265321.925747:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789265321.925785:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397552640 00000100:00100000:3.0:1789265321.925794:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397552640 00010000:00010000:1.0:1789265321.926899:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265321.926915:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000df92b299/0x27274ba5bb952dcf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265321.926941:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad6c00 already unused, calling callback (ffffffffc1581350) 00010000:00010000:1.0:1789265321.926947:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000df92b299/0x27274ba5bb952dcf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265321.926960:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000df92b299/0x27274ba5bb952dcf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265321.926997:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000df92b299/0x27274ba5bb952dcf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265321.927006:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df92b299/0x27274ba5bb952dcf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265321.927036:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265321.927038:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265321.927040:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265321.927280:0:12007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 68 00000100:00100000:2.0:1789265321.927303:0:12007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103ba7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+12:2350:x1876180397552640:12345-192.168.203.37@tcp:16:lhsmtool_posix.0 00000004:00080000:3.0:1789265321.927629:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a102eb0a300/2, rc 0, transno 4294967322 00000100:00100000:3.0:1789265321.927638:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102eb0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414311680:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789265321.979879:0:12007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103ba7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+12:2350:x1876180397552640:12345-192.168.203.37@tcp:16:lhsmtool_posix.0 Request processed in 52569us (57103us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265321.979897:0:12007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 68 00000001:00080000:1.0:1789265321.981215:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967318 is committed 00000001:00080000:1.0:1789265321.981240:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967317 is committed 00000001:00080000:1.0:1789265321.981254:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:1.0:1789265321.981265:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967319 is committed 00000001:00080000:1.0:1789265321.981272:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:1.0:1789265321.981278:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000100:00100000:1.0:1789265321.984614:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265321.985573:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397553024 00000100:00100000:3.0:1789265321.985588:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397553024 00000100:00100000:3.0:1789265321.985731:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 228 00000100:00100000:3.0:1789265321.985744:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103ba7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+20:11585:x1876180397553024:12345-192.168.203.37@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789265321.985816:0:7934:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265321.985860:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35800/0x27274ba5bb952dba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0139 expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265321.985885:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8a1002ca3000) 00010000:00010000:3.0:1789265321.985891:0:7934:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789265321.986318:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9400/0x27274ba5bb952ddd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265321.986338:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9400/0x27274ba5bb952ddd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265321.986350:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9400/0x27274ba5bb952ddd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789265321.986711:0:7934:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c06b06e2 reply state 00000000bcfb513c transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9400/0x27274ba5bb952ddd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265321.986722:0:7934:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789265321.987354:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103ba7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+21:11585:x1876180397553024:12345-192.168.203.37@tcp:36:lhsmtool_posix.0 Request processed in 1607us (2746us total) trans 4294967508 rc 0/0 00000100:00100000:3.0:1789265321.987366:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 228 00000100:00100000:2.0:1789265321.991527:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265321.992294:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397553152 00000100:00100000:0.0:1789265321.992309:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397553152 00000100:00100000:0.0:1789265321.992396:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 69 00000100:00100000:0.0:1789265321.992418:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102eb09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+7:2349:x1876180397553152:12345-192.168.203.37@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789265321.992755:0:8856:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1789265321.992760:0:8856:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1789265322 -> 1789265321 00002000:00010000:0.0:1789265321.992763:0:8856:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1789265320 00002000:00010000:0.0:1789265321.992765:0:8856:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1789265322 -> 1789265321 00002000:00010000:0.0:1789265321.992768:0:8856:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1789265321.993334:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102eb09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+8:2349:x1876180397553152:12345-192.168.203.37@tcp:2:lhsmtool_posix.0 Request processed in 924us (1818us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1789265321.993364:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 69 00010000:00010000:3.0:1789265321.996716:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9400/0x27274ba5bb952ddd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265321.996751:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9400/0x27274ba5bb952ddd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265321.996759:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9400/0x27274ba5bb952ddd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265321.996766:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fae9400 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789265321.996773:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9400/0x27274ba5bb952ddd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265321.996781:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9400/0x27274ba5bb952ddd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265321.996804:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8a1002ca3000) 00010000:00010000:3.0:1789265321.996807:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265321.996812:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9400/0x27274ba5bb952ddd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265321.996818:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9400/0x27274ba5bb952ddd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265321.997797:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265321.998273:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397553408 00000100:00100000:2.0:1789265321.998287:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397553408 00000100:00100000:2.0:1789265321.998418:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 229 00000100:00100000:2.0:1789265321.998431:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103ba78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+20:11585:x1876180397553408:12345-192.168.203.37@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789265321.998526:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952de4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265321.998547:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34200/0x27274ba5bb952d9e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f012b expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265321.998557:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952de4 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265321.998604:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34200/0x27274ba5bb952d9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f012b expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265321.998642:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34200/0x27274ba5bb952d9e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f012b expref: 20 pid: 5841 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265321.998661:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102eb08380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1876180414312192:192.168.203.37@tcp:104: 00000100:00100000:2.0:1789265321.998788:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1011d2b540 going to sleep for 11 seconds 00000100:00100000:2.0:1789265322.002651:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102eb08380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1876180414312192:192.168.203.37@tcp:104: 00010000:00010000:2.0:1789265322.002709:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952de4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265322.005366:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265322.005746:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397553536 00000100:00100000:2.0:1789265322.005760:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397553536 00010000:00010000:2.0:1789265322.005816:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34200/0x27274ba5bb952d9e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f012b expref: 21 pid: 5841 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265322.005866:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 82 00000100:00100000:2.0:1789265322.005877:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103ba7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+21:2350:x1876180397553536:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265322.005897:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265322.005904:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34200/0x27274ba5bb952d9e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f012b expref: 21 pid: 5841 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.005922:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34200/0x27274ba5bb952d9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f012b expref: 21 pid: 5841 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.005965:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34200/0x27274ba5bb952d9e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f012b expref: 21 pid: 5841 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.006219:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8a1002ca3000) 00010000:00010000:2.0:1789265322.006227:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952de4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.006240:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952de4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.006250:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952de4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.006285:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265322.006362:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103ba7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+20:2350:x1876180397553536:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 486us (1011us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265322.006371:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 82 00010000:00010000:0.0:1789265322.006602:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952de4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265322.006612:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952de4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265322.006651:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952de4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265322.006660:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952de4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265322.006669:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952de4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265322.006677:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad6a00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789265322.006683:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952de4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265322.006692:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952de4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265322.006702:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8a1002ca3000) 00010000:00010000:0.0:1789265322.006705:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789265322.006709:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952de4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265322.006717:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952de4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265322.006787:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103ba78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+19:11585:x1876180397553408:12345-192.168.203.37@tcp:55:lhsmtool_posix.0 Request processed in 8359us (9001us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789265322.006797:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 229 00000100:00100000:0.0:1789265322.011536:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265322.011645:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397553664 00000100:00100000:3.0:1789265322.011659:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397553664 00000100:00100000:3.0:1789265322.011761:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 70 00000100:00100000:3.0:1789265322.011774:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102eecd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+8:2348:x1876180397553664:12345-192.168.203.37@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789265322.011856:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ecc08219/0x27274ba5bb952deb lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265322.011902:0:6685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f1451423/0x27274ba5bb952dc8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0147 expref: 8 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265322.011914:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265322.011919:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789265322.011936:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ecc08219/0x27274ba5bb952deb lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265322.011993:0:6685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f1451423/0x27274ba5bb952dc8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0147 expref: 8 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265322.012013:0:6685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f1451423/0x27274ba5bb952dc8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0147 expref: 8 pid: 6684 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265322.012031:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103fc41f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6685:1876180414312320:192.168.203.37@tcp:104: 00000100:00100000:3.0:1789265322.012223:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a102ec330c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265322.019577:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265322.019720:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397553792 00000100:00100000:0.0:1789265322.019732:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397553792 00010000:00010000:0.0:1789265322.019789:0:8490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f1451423/0x27274ba5bb952dc8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0147 expref: 9 pid: 6684 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265322.019850:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 83 00000100:00100000:0.0:1789265322.019861:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103ba7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+9:2351:x1876180397553792:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265322.019879:0:8490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265322.019911:0:8490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f1451423/0x27274ba5bb952dc8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0147 expref: 9 pid: 6684 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265322.019942:0:8490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f1451423/0x27274ba5bb952dc8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0147 expref: 9 pid: 6684 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265322.019995:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789265322.020001:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789265322.020008:0:8490:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ecc08219/0x27274ba5bb952deb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265322.020021:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ecc08219/0x27274ba5bb952deb lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265322.020106:0:8490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265322.020178:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103ba7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+9:2351:x1876180397553792:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 318us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265322.020185:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 83 00010000:00010000:2.0:1789265322.021385:0:6685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1451423/0x27274ba5bb952dc8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0147 expref: 8 pid: 6684 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265322.021490:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103fc41f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6685:1876180414312320:192.168.203.37@tcp:104: 00010000:00010000:2.0:1789265322.021524:0:6685:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ecc08219/0x27274ba5bb952deb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.021539:0:6685:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ecc08219/0x27274ba5bb952deb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.021547:0:6685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ecc08219/0x27274ba5bb952deb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.021616:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ecc08219/0x27274ba5bb952deb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.021625:0:6685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ecc08219/0x27274ba5bb952deb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.021634:0:6685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ecc08219/0x27274ba5bb952deb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.021641:0:6685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fae9400 already unused, calling callback (ffffffffc1581350) 00010000:00010000:2.0:1789265322.021645:0:6685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ecc08219/0x27274ba5bb952deb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.021656:0:6685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ecc08219/0x27274ba5bb952deb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.021676:0:6685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ecc08219/0x27274ba5bb952deb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.021684:0:6685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ecc08219/0x27274ba5bb952deb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265322.021773:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102eecd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+7:2348:x1876180397553664:12345-192.168.203.37@tcp:1:lhsmtool_posix.0 Request processed in 10002us (10253us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265322.021783:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 70 00000100:00100000:1.0:1789265322.026036:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265322.026833:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397554048 00000100:00100000:2.0:1789265322.026909:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397554048 00000100:00100000:2.0:1789265322.027539:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 230 00000100:00100000:2.0:1789265322.027553:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103ba79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+19:11585:x1876180397554048:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789265322.027666:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952df2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.027689:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952df2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.027702:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952df2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.028145:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb952df9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.028161:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb952dac lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0132 expref: 20 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.028170:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb952df9 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.028304:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb952dac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0132 expref: 20 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.028327:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb952dac lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0132 expref: 20 pid: 11857 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265322.028346:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102eb08380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1876180414312448:192.168.203.37@tcp:104: 00000100:00100000:2.0:1789265322.028648:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1011d2b540 going to sleep for 11 seconds 00000100:00100000:1.0:1789265322.033268:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102eb08380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1876180414312448:192.168.203.37@tcp:104: 00010000:00010000:1.0:1789265322.033309:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb952df9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265322.036443:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265322.036580:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397554176 00000100:00100000:2.0:1789265322.036593:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397554176 00010000:00010000:2.0:1789265322.036652:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb952dac lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0132 expref: 21 pid: 11857 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265322.036705:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 84 00000100:00100000:2.0:1789265322.036719:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102eecfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+21:2350:x1876180397554176:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265322.036741:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265322.036749:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb952dac lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0132 expref: 21 pid: 11857 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.036767:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb952dac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0132 expref: 21 pid: 11857 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.036794:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb952dac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0132 expref: 21 pid: 11857 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.036815:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8a1002ca3000) 00010000:00010000:2.0:1789265322.036822:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb952df9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.036833:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb952df9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.036855:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb952df9 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.036895:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265322.036978:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102eecfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+20:2350:x1876180397554176:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 254us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265322.037004:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 84 00010000:00010000:1.0:1789265322.037195:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb952df9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265322.037219:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb952df9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789265322.037476:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:1.0:1789265322.037664:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:1.0:1789265322.037716:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:1.0:1789265322.037825:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02e31500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5840:1876180414312576:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789265322.037921:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265322.037983:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a0f0294c840 going to sleep for 11 seconds 00000100:00100000:3.0:1789265322.038352:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414312576 00000100:00100000:3.0:1789265322.038361:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414312576 00000100:00100000:3.0:1789265322.038415:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789265322.038425:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02e30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5840:x1876180414312576:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789265322.038523:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02e30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5840:x1876180414312576:12345-0@lo:1000:mdt00_000.0 Request processed in 99us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265322.038531:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789265322.038851:0:5840:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:1.0:1789265322.038859:0:5840:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967322 00000004:00080000:1.0:1789265322.038883:0:5840:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a102eb0ad80, transno 4294967321 00000004:00080000:1.0:1789265322.038899:0:5840:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a102eb0a300, transno 4294967322 00000100:00100000:1.0:1789265322.038908:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02e31500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5840:1876180414312576:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1789265322.039920:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:1.0:1789265322.041602:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02e31500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5840:1876180414312704:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789265322.041698:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265322.041764:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a0f0294c300 going to sleep for 11 seconds 00000100:00100000:0.0:1789265322.043036:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414312704 00000100:00100000:0.0:1789265322.043052:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414312704 00000100:00100000:0.0:1789265322.043156:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789265322.043168:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02e30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5840:x1876180414312704:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789265322.043724:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02e30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5840:x1876180414312704:12345-0@lo:1000:mdt00_000.0 Request processed in 555us (2023us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1789265322.043734:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789265322.044059:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02e31500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5840:1876180414312704:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1789265322.044439:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb952df9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.044452:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb952df9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.044460:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb952df9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.044466:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad6600 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789265322.044471:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb952df9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.044481:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb952df9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.044501:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8a1002ca3000) 00010000:00010000:2.0:1789265322.044505:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789265322.044510:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb952df9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.044516:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb952df9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.044558:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34400/0x27274ba5bb952d3c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.044565:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34400/0x27274ba5bb952d3c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.044591:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34400/0x27274ba5bb952d3c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.044597:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fa34400 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789265322.044601:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34400/0x27274ba5bb952d3c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.044607:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34400/0x27274ba5bb952d3c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.044616:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a1002ca3700) 00010000:00010000:2.0:1789265322.044618:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789265322.044627:0:5840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596e00/0x27274ba5bb952d43 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0116 expref: 23 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.044641:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596e00/0x27274ba5bb952d43 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0116 expref: 23 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.044651:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596e00/0x27274ba5bb952d43 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0116 expref: 23 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.044696:0:5840:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596e00/0x27274ba5bb952d43 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0116 expref: 23 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265322.044715:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102eb0ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1876180414312832:192.168.203.37@tcp:105: 00000100:00100000:2.0:1789265322.044814:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1011d2b600 going to sleep for 11 seconds 00000100:00100000:0.0:1789265322.048362:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265322.048567:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102eb0ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1876180414312832:192.168.203.37@tcp:105: 00010000:00010000:2.0:1789265322.048625:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34400/0x27274ba5bb952d3c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.048637:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34400/0x27274ba5bb952d3c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.048684:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952e00 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.048703:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952e00 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.048718:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952e00 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.048731:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952e00 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.048738:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952e00 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.048746:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952e00 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.048753:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad6a00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789265322.048757:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952e00 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.048766:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952e00 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.048780:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a1002ca3700) 00010000:00010000:2.0:1789265322.048784:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265322.048795:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952e00 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.048802:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952e00 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.048814:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952df2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.048821:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952df2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.048827:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952df2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.048833:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad7a00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789265322.048836:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952df2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.048844:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952df2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.048853:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a1002ca3700) 00010000:00010000:2.0:1789265322.048855:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789265322.048858:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952df2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.048866:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952df2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265322.049390:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103ba79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+23:11585:x1876180397554048:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 Request processed in 21836us (23367us total) trans 4294967513 rc 0/0 00000100:00100000:2.0:1789265322.049403:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 230 00000020:00080000:2.0:1789265322.049419:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789265322.049803:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789265322.049809:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789265322.050609:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1789265322.050625:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789265322.051826:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397554304 00000100:00100000:3.0:1789265322.051846:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397554304 00000100:00100000:3.0:1789265322.051927:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 61 00000100:00100000:3.0:1789265322.051941:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102eecf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+23:11584:x1876180397554304:12345-192.168.203.37@tcp:49:lfs.0 00000100:00100000:1.0:1789265322.053707:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102eecf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+23:11584:x1876180397554304:12345-192.168.203.37@tcp:49:lfs.0 Request processed in 1756us (5345us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265322.053720:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 61 00000100:00100000:0.0:1789265322.055990:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265322.056138:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265322.056374:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397554816 00000100:00100000:3.0:1789265322.056387:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397554816 00000100:00100000:3.0:1789265322.056459:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 231 00000100:00100000:3.0:1789265322.056471:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102eece300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+23:11584:x1876180397554816:12345-192.168.203.37@tcp:58:lfs.0 00000040:00080000:3.0:1789265322.057006:0:7934:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1789265322.057494:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102eece300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+23:11584:x1876180397554816:12345-192.168.203.37@tcp:58:lfs.0 Request processed in 1022us (1351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265322.057506:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 231 00000100:00100000:2.0:1789265322.058827:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397554560 00000100:00100000:2.0:1789265322.058844:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397554560 00000100:00100000:2.0:1789265322.058981:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 62 00000100:00100000:2.0:1789265322.058993:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1010a41450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+23:11585:x1876180397554560:12345-192.168.203.37@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789265322.060673:0:5843:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789265322.060811:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00010000:00010000:2.0:1789265322.060878:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952e07 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.060899:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952e07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.060914:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952e07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.060924:0:5843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952e07 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.060932:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952e07 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.060938:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952e07 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.061122:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789265322.061606:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1010a41450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+25:11585:x1876180397554560:12345-192.168.203.37@tcp:35:lhsmtool_posix.0 Request processed in 2608us (5631us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1789265322.061618:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 62 00000020:00080000:2.0:1789265322.061626:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789265322.073178:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265322.073209:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952e07 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265322.073341:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad7a00 already unused, calling callback (ffffffffc1581350) 00010000:00010000:0.0:1789265322.073347:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952e07 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265322.073387:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952e07 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265322.073424:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8a1012931000) 00010000:00010000:0.0:1789265322.073428:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789265322.073434:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952e07 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265322.073441:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952e07 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265322.073476:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265322.073479:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265322.073481:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265322.099691:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265322.099820:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397554944 00000100:00100000:2.0:1789265322.099857:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397554944 00000100:00100000:2.0:1789265322.099937:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 232 00000100:00100000:2.0:1789265322.099950:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102eeced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+25:11587:x1876180397554944:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:2.0:1789265322.099990:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265322.100024:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952e0e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f014e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.100157:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb952e15 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.100176:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb952e15 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.100190:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb952e15 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265322.100785:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34000/0x27274ba5bb952e1c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265322.100798:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34000/0x27274ba5bb952e1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265322.100808:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34000/0x27274ba5bb952e1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265322.101788:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35c00/0x27274ba5bb952e23 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265322.101808:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35e00/0x27274ba5bb952d2e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f010f expref: 26 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265322.101817:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35c00/0x27274ba5bb952e23 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265322.101880:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35e00/0x27274ba5bb952d2e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f010f expref: 26 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265322.101904:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35e00/0x27274ba5bb952d2e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f010f expref: 26 pid: 5841 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265322.101924:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102eecf480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1876180414312960:192.168.203.37@tcp:104: 00000100:00100000:0.0:1789265322.102430:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103bb473c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265322.106847:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102eecf480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1876180414312960:192.168.203.37@tcp:104: 00010000:00010000:0.0:1789265322.106889:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35c00/0x27274ba5bb952e23 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265322.108603:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265322.108801:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397555200 00000100:00100000:1.0:1789265322.108814:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397555200 00000100:00100000:1.0:1789265322.108953:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 63 00000100:00100000:1.0:1789265322.108964:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102eecf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+27:5586:x1876180397555200:12345-192.168.203.37@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789265322.110189:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102eecf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+28:5586:x1876180397555200:12345-192.168.203.37@tcp:35:ldlm_bl.0 Request processed in 1217us (1590us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1789265322.110287:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 63 00000100:00100000:3.0:1789265322.120414:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265322.120532:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397555328 00000100:00100000:0.0:1789265322.120547:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397555328 00010000:00010000:0.0:1789265322.120607:0:8490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35e00/0x27274ba5bb952d2e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f010f expref: 28 pid: 5841 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265322.120657:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 85 00000100:00100000:0.0:1789265322.120669:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103fc40a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+28:2350:x1876180397555328:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265322.120688:0:8490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265322.120697:0:8490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35e00/0x27274ba5bb952d2e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f010f expref: 28 pid: 5841 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265322.120715:0:8490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35e00/0x27274ba5bb952d2e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f010f expref: 28 pid: 5841 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265322.120771:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35e00/0x27274ba5bb952d2e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f010f expref: 28 pid: 5841 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265322.120792:0:8490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a1002ca3700) 00010000:00010000:0.0:1789265322.120799:0:8490:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35c00/0x27274ba5bb952e23 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265322.120810:0:8490:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35c00/0x27274ba5bb952e23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265322.120819:0:8490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35c00/0x27274ba5bb952e23 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265322.120875:0:8490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265322.121327:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103fc40a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+27:2350:x1876180397555328:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 656us (931us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265322.121337:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 85 00010000:00010000:2.0:1789265322.121570:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35c00/0x27274ba5bb952e23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.121581:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35c00/0x27274ba5bb952e23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265322.121658:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789265322.121663:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789265322.121690:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35c00/0x27274ba5bb952e23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.121706:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35c00/0x27274ba5bb952e23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.121717:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb952e15 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.121741:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb952e15 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.121749:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb952e15 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.121757:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad6600 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789265322.121762:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb952e15 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.121770:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb952e15 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.121784:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a101cdf4400) 00010000:00010000:2.0:1789265322.121787:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265322.121792:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb952e15 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.121799:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb952e15 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.121816:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34000/0x27274ba5bb952e1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.121821:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34000/0x27274ba5bb952e1c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.121827:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34000/0x27274ba5bb952e1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.121833:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fa34000 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789265322.121849:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34000/0x27274ba5bb952e1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.121856:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34000/0x27274ba5bb952e1c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.121872:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8a1012931700) 00010000:00010000:2.0:1789265322.121875:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265322.121878:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34000/0x27274ba5bb952e1c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.121884:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34000/0x27274ba5bb952e1c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.121942:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952e0e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f014e expref: 27 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.121958:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35c00/0x27274ba5bb952e23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f014e expref: 26 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265322.121965:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a1002ca3700) 00010000:00010000:2.0:1789265322.121968:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789265322.121979:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fa35c00, rc 0) 00000100:00100000:2.0:1789265322.122830:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102eeced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+26:11587:x1876180397554944:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 22876us (23148us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265322.123510:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 232 00000100:00100000:3.0:1789265322.228716:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265322.228771:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265322.228820:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265322.229180:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397555712 00000100:00100000:1.0:1789265322.229192:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397555712 00000100:00100000:1.0:1789265322.229282:0:11857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 146 00000100:00100000:1.0:1789265322.229295:0:11857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103fc43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+5:2351:x1876180397555712:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789265322.229391:0:11857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103fc43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+5:2351:x1876180397555712:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 99us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265322.229399:0:11857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 146 00000100:00100000:0.0:1789265322.229550:0:12007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397555584 00000100:00100000:0.0:1789265322.229555:0:12007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397555584 00000100:00100000:0.0:1789265322.229596:0:12007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 89 00000100:00100000:0.0:1789265322.229604:0:12007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103fc41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+7:2351:x1876180397555584:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789265322.229636:0:12007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103fc41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+7:2351:x1876180397555584:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 34us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265322.229643:0:12007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 89 00000100:00080000:3.0:1789265322.230236:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789265322.230243:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265322.230864:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397555456 00000100:00100000:2.0:1789265322.230875:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397555456 00000100:00100000:2.0:1789265322.230935:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 293 00000100:00100000:2.0:1789265322.230944:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+13:2351:x1876180397555456:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789265322.231038:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+13:2351:x1876180397555456:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 95us (2339us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265322.231045:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 293 00000100:00100000:3.0:1789265322.292958:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789265322.293001:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103fc41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414313088:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789265322.293135:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265322.293248:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414313088 00000100:00100000:3.0:1789265322.293259:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414313088 00000100:00100000:3.0:1789265322.293324:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789265322.293337:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103fc43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1876180414313088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789265322.293368:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1789265322.293437:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103fc43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1876180414313088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265322.293845:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103fc41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414313088:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789265322.293959:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00010000:1.0:1789265322.294312:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789265323.061359:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789265323.061370:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789265323.061412:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1789265323.061421:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789265323.061546:0:11671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102eb09500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11671:1876180414313216:192.168.203.37@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789265323.061634:0:11671:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1011d2ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1789265323.074109:0:11671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102eb09500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11671:1876180414313216:192.168.203.37@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789265323.081798:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265323.081987:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397555840 00000100:00100000:1.0:1789265323.081998:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397555840 00000100:00100000:1.0:1789265323.082094:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 233 00000100:00100000:1.0:1789265323.082105:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102eb0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+26:11598:x1876180397555840:12345-192.168.203.37@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789265323.082139:0:7934:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789265323.082616:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102eb0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+26:11598:x1876180397555840:12345-192.168.203.37@tcp:53:lhsmtool_posix.0 Request processed in 139us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265323.082636:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 233 00000100:00080000:2.0:1789265323.082999:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265323.096987:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265323.097322:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397556096 00000100:00100000:2.0:1789265323.097333:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397556096 00000100:00100000:2.0:1789265323.097388:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 234 00000100:00100000:2.0:1789265323.097396:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102eecdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+26:11598:x1876180397556096:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789265323.097415:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265323.097435:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb952e2a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f0155 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265323.097536:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7e00/0x27274ba5bb952e31 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265323.097552:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7e00/0x27274ba5bb952e31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265323.097563:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7e00/0x27274ba5bb952e31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265323.097585:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789265323.097715:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6200/0x27274ba5bb952e2a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0155 expref: 29 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265323.097731:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7e00/0x27274ba5bb952e31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0155 expref: 28 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265323.097740:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a1002ca3700) 00010000:00010000:2.0:1789265323.097743:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789265323.097747:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fad7e00, rc 0) 00000100:00100000:2.0:1789265323.097889:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102eecdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+28:11598:x1876180397556096:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 492us (911us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1789265323.097896:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 234 00000100:00100000:2.0:1789265323.110015:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265323.110072:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397556480 00000100:00100000:1.0:1789265323.110103:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397556480 00000100:00100000:2.0:1789265323.110138:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265323.110160:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 235 00000100:00100000:1.0:1789265323.110170:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102eb0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+28:11598:x1876180397556480:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789265323.110723:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb952e3f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265323.110744:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb952e3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265323.110941:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb952e3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265323.111228:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb952e3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265323.111237:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb952e3f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265323.111317:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb952e3f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265323.111325:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b597200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789265323.111329:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb952e3f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265323.111338:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb952e3f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265323.111363:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a1002ca3700) 00010000:00010000:1.0:1789265323.111366:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789265323.111371:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb952e3f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265323.111378:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb952e3f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265323.111612:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102eb0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+29:11598:x1876180397556480:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 Request processed in 1440us (1603us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1789265323.111622:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 235 00000100:00100000:3.0:1789265323.113612:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397556224 00000100:00100000:3.0:1789265323.113627:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397556224 00000040:00080000:1.0:1789265323.114204:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789265323.114210:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789265323.115101:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1789265323.115113:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789265323.115899:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 18 00000100:00100000:3.0:1789265323.115918:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10118e6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+29:2350:x1876180397556224:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265323.115939:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265323.115981:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7e00/0x27274ba5bb952e31 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0155 expref: 29 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265323.116000:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a1002ca3700) 00010000:00010000:3.0:1789265323.116006:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265323.117689:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10118e6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+28:2350:x1876180397556224:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 1767us (7540us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265323.117705:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 18 00000100:00100000:0.0:1789265323.123240:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265323.123928:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397556736 00000100:00100000:2.0:1789265323.123938:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397556736 00000100:00100000:2.0:1789265323.124006:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 64 00000100:00100000:2.0:1789265323.124016:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102eecc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+28:11598:x1876180397556736:12345-192.168.203.37@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789265323.124408:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102eecc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+29:11598:x1876180397556736:12345-192.168.203.37@tcp:35:lhsmtool_posix.0 Request processed in 387us (1170us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1789265323.124416:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 64 00000040:00080000:1.0:1789265323.135974:0:12502:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789265323.135985:0:12502:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789265323.136035:0:12502:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1789265323.136041:0:12502:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1789265323.318211:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265323.413477:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265323.413531:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397556992 00000100:00100000:2.0:1789265323.413544:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397556992 00000100:00100000:2.0:1789265323.413607:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 236 00000100:00100000:2.0:1789265323.413748:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102eecea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+29:11611:x1876180397556992:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:2.0:1789265323.413913:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265323.413934:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb952e46 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f015c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265323.414050:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952e4d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265323.414067:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952e4d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265323.414133:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952e4d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265323.414145:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1789265323.414352:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6600/0x27274ba5bb952e46 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f015c expref: 32 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265323.414373:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952e4d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f015c expref: 31 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265323.414380:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a1002ca3700) 00010000:00010000:1.0:1789265323.414383:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789265323.414393:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fad6a00, rc 0) 00000100:00100000:1.0:1789265323.414456:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102eecea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+31:11611:x1876180397556992:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 840us (986us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1789265323.414464:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 236 00000100:00100000:2.0:1789265323.421445:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265323.425012:0:11857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397557120 00000100:00100000:0.0:1789265323.425027:0:11857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397557120 00000100:00100000:0.0:1789265323.425165:0:11857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 237 00000100:00100000:0.0:1789265323.425176:0:11857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102eb0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+31:11611:x1876180397557120:12345-192.168.203.37@tcp:54:lfs.0 00010000:00010000:0.0:1789265323.425249:0:11857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35200/0x27274ba5bb952e5b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265323.425266:0:11857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35200/0x27274ba5bb952e5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265323.425277:0:11857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35200/0x27274ba5bb952e5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265323.425302:0:11857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35200/0x27274ba5bb952e5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265323.425308:0:11857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35200/0x27274ba5bb952e5b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265323.425314:0:11857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35200/0x27274ba5bb952e5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265323.425318:0:11857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fa35200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789265323.425322:0:11857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35200/0x27274ba5bb952e5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265323.425329:0:11857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35200/0x27274ba5bb952e5b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265323.425341:0:11857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a1002ca3700) 00010000:00010000:0.0:1789265323.425355:0:11857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789265323.425361:0:11857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35200/0x27274ba5bb952e5b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265323.425368:0:11857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35200/0x27274ba5bb952e5b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265323.425466:0:11857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102eb0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+31:11611:x1876180397557120:12345-192.168.203.37@tcp:54:lfs.0 Request processed in 292us (4029us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265323.425474:0:11857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 237 00000100:00100000:2.0:1789265323.586457:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265323.586664:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397557248 00000100:00100000:0.0:1789265323.586676:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397557248 00000100:00100000:0.0:1789265323.586756:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 71 00000100:00100000:0.0:1789265323.586768:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102eb09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+7:2349:x1876180397557248:12345-192.168.203.37@tcp:101:cat.0 00010000:00010000:0.0:1789265323.586784:0:8856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265323.586814:0:8856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000038df497b/0x27274ba5bb952e62 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f0163 expref: -99 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789265323.586850:0:8856:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6aa605a9, atime: 0x6aa605a8, ctime: 0x6aa605a9, blocks: 0xb 00010000:00010000:0.0:1789265323.586870:0:8856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=369s v=(0 0) 00010000:00010000:0.0:1789265323.586874:0:8856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265323.586884:0:8856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038df497b/0x27274ba5bb952e62 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0163 expref: 8 pid: 8856 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265323.586905:0:8856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000038df497b/0x27274ba5bb952e62 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0163 expref: 8 pid: 8856 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265323.586918:0:8856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fa35200, rc 0) 00000100:00100000:0.0:1789265323.587005:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102eb09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+8:2349:x1876180397557248:12345-192.168.203.37@tcp:101:cat.0 Request processed in 240us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265323.587013:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 71 00000100:00080000:2.0:1789265323.587466:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789265323.593855:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265323.594024:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397557376 00000100:00100000:1.0:1789265323.594034:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397557376 00002000:00100000:1.0:1789265323.594118:0:6690:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff8a102eb08380 x1876180397557376/t0(0) o3->4b820fcb-1bab-4b78-bfa4-355c22a09cf8@192.168.203.37@tcp:649/0 lens 488/0 e 0 to 0 dl 1789265334 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789265323.594129:0:6690:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a102eb08380 with x1876180397557376 ext(0->4095) 00002000:00010000:1.0:1789265323.594135:0:6690:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a102eb08380 00000100:00100000:1.0:1789265323.594157:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 7 00000100:00100000:1.0:1789265323.594166:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102eb08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+8:2351:x1876180397557376:12345-192.168.203.37@tcp:3:cat.0 00000100:00100000:1.0:1789265323.594363:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102eb08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+8:2351:x1876180397557376:12345-192.168.203.37@tcp:3:cat.0 Request processed in 198us (518us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789265323.594375:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 7 00002000:00100000:1.0:1789265323.594382:0:6690:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff8a102eb08380 x1876180397557376/t0(0) o3->4b820fcb-1bab-4b78-bfa4-355c22a09cf8@192.168.203.37@tcp:649/0 lens 488/4536 e 0 to 0 dl 1789265334 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789265323.594390:0:6690:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a102eb08380 with x1876180397557376 ext(0->4095) 00002000:00010000:1.0:1789265323.594394:0:6690:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a102eb08380 00000001:00080000:3.0:1789265323.908018:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:3.0:1789265323.908040:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00010000:00010000:1.0:1789265324.339988:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265325.366022:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265325.876240:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103fc40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414313344:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789265325.876345:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265325.876479:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414313344 00000100:00100000:1.0:1789265325.876491:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414313344 00000100:00100000:1.0:1789265325.876838:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789265325.876850:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102eecd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414313344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789265325.876899:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789265325.876979:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102eecd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414313344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265325.877566:0:3315:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1789265325.877576:0:3315:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:0.0:1789265325.877601:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a102eecf800, transno 4294967310 00000100:00100000:0.0:1789265325.877639:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103fc40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414313344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789265325.880512:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:2.0:1789265325.881314:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1789265326.194367:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789265326.194381:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789265326.194452:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1789265326.194471:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1789265326.386825:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265326.898673:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102eb0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:871daf34-1206-40e7-bd71-78303abe4d37:3316:1876180414313472:0@lo:400:kworker.0 00000100:00100000:1.0:1789265326.898773:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265326.898881:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414313472 00000100:00100000:3.0:1789265326.898890:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414313472 00000100:00100000:3.0:1789265326.898961:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1789265326.898972:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+19:3316:x1876180414313472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265326.899147:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102eb09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1876180414313728:0@lo:400:kworker.0 00000100:00100000:2.0:1789265326.899199:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265326.899230:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789265326.899236:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102eb08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876180414313600:0@lo:400:kworker.0 00000100:00100000:2.0:1789265326.899265:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265326.899309:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414313728 00000100:00100000:2.0:1789265326.899313:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414313728 00000100:00100000:2.0:1789265326.899361:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414313600 00000100:00100000:2.0:1789265326.899364:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414313600 00000100:00100000:2.0:1789265326.899733:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789265326.899742:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008e24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1876180414313728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265326.899812:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008e24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1876180414313728:12345-0@lo:400:kworker.0 Request processed in 71us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265326.899821:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789265326.899843:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789265326.899850:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008755f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876180414313600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265326.899880:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008755f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876180414313600:12345-0@lo:400:kworker.0 Request processed in 30us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265326.899886:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:2.0:1789265326.899910:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265326.899967:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102eb08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876180414313600:0@lo:400:kworker.0 00000100:00100000:2.0:1789265326.899980:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102eb09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1876180414313728:0@lo:400:kworker.0 00000100:00100000:3.0:1789265326.906317:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+19:3316:x1876180414313472:12345-0@lo:400:kworker.0 Request processed in 7331us (7528us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265326.906338:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1789265326.909370:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102eb09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414313856:0@lo:400:kworker.0 00000100:00100000:3.0:1789265326.909474:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265326.909571:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414313856 00000100:00100000:3.0:1789265326.909589:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414313856 00000100:00100000:3.0:1789265326.909654:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789265326.909664:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103fc43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414313856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265326.909731:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103fc43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414313856:12345-0@lo:400:kworker.0 Request processed in 68us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265326.909739:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789265326.909792:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102eb09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414313856:0@lo:400:kworker.0 00000100:00100000:1.0:1789265326.911391:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102eb0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:871daf34-1206-40e7-bd71-78303abe4d37:3316:1876180414313472:0@lo:400:kworker.0 00000100:00100000:1.0:1789265326.912463:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789265326.912486:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02e32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1876180414313984:0@lo:400:kworker.0 00000100:00100000:0.0:1789265326.912544:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102eecf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414314112:0@lo:400:kworker.0 00000100:00100000:1.0:1789265326.912579:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265326.912580:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265326.921397:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414314112 00000100:00100000:1.0:1789265326.921418:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414314112 00000100:00100000:1.0:1789265326.921504:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789265326.921517:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102eecdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3317:x1876180414314112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265326.921617:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102eecdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3317:x1876180414314112:12345-0@lo:400:kworker.0 Request processed in 103us (9035us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265326.921624:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789265326.921655:0:11857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414313984 00000100:00100000:1.0:1789265326.921659:0:11857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414313984 00000100:00100000:1.0:1789265326.921692:0:11857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789265326.921699:0:11857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02e33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876180414313984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265326.921756:0:11857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02e33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876180414313984:12345-0@lo:400:kworker.0 Request processed in 58us (9178us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265326.921763:0:11857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789265326.922637:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02e32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1876180414313984:0@lo:400:kworker.0 00000100:00080000:1.0:1789265326.922672:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789265326.922678:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789265326.925325:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102eecf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414314112:0@lo:400:kworker.0 00000001:00080000:3.0:1789265327.002300:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:3.0:1789265327.002325:0:5863:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8a0f0294c840 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1789265327.002331:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a1010765000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8a0f0294c6c0 00000020:00080000:3.0:1789265327.002335:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a1010765d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8a1034bd7800 00000020:00080000:3.0:1789265327.002395:0:5863:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:1.0:1789265327.002962:0:5874:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1789265327.003761:0:5874:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:3.0:1789265327.345878:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265327.345947:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265327.345994:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265327.346024:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265327.346051:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265327.346124:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397557504 00000100:00100000:3.0:1789265327.346137:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397557504 00000100:00100000:0.0:1789265327.346273:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397557888 00000100:00100000:0.0:1789265327.346279:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397557888 00000100:00100000:0.0:1789265327.346352:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397557760 00000100:00100000:0.0:1789265327.346368:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397557760 00000100:00100000:0.0:1789265327.346407:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 92 00000100:00100000:0.0:1789265327.346418:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103fc42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+8:2348:x1876180397557888:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789265327.346823:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103fc42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+8:2348:x1876180397557888:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 405us (874us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265327.346833:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 92 00000100:00100000:0.0:1789265327.346856:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 93 00000100:00100000:0.0:1789265327.346863:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103fc43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+5:2348:x1876180397557760:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789265327.346894:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103fc43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+5:2348:x1876180397557760:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 32us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265327.346922:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 93 00000100:00080000:0.0:1789265327.346957:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789265327.346963:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789265327.346988:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397557632 00000100:00100000:2.0:1789265327.346995:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397557632 00000100:00100000:2.0:1789265327.347046:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397558016 00000100:00100000:2.0:1789265327.347050:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397558016 00000100:00100000:2.0:1789265327.347091:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 150 00000100:00100000:2.0:1789265327.347100:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103fc42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+18:2348:x1876180397557632:12345-192.168.203.37@tcp:400:kworker.0 00000100:00080000:0.0:1789265327.347102:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265327.347142:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103fc42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+18:2348:x1876180397557632:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 44us (1671us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265327.347151:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 150 00000100:00100000:2.0:1789265327.347166:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 151 00000100:00100000:2.0:1789265327.347173:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103fc41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+5:2348:x1876180397558016:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789265327.347212:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103fc41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+5:2348:x1876180397558016:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 39us (1160us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265327.347229:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 151 00000100:00100000:3.0:1789265327.347275:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 295 00000100:00100000:3.0:1789265327.347286:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1230cd-a81b-4bcc-a532-e24f5353fef4+13:2348:x1876180397557504:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789265327.347322:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1230cd-a81b-4bcc-a532-e24f5353fef4+13:2348:x1876180397557504:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 40us (1328us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265327.347331:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 295 00010000:00010000:0.0:1789265327.410480:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265327.412865:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789265327.412899:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103fc40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414314240:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789265327.413010:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265327.414180:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414314240 00000100:00100000:3.0:1789265327.414195:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414314240 00000100:00100000:3.0:1789265327.414276:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789265327.414288:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02e32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1876180414314240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789265327.414336:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789265327.414549:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02e32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1876180414314240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 260us (1537us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265327.414559:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789265327.415378:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103fc40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414314240:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1789265327.470694:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:0.0:1789265327.470849:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00010000:00010000:3.0:1789265328.434781:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265329.116725:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265329.116971:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397558144 00000100:00100000:1.0:1789265329.116985:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397558144 00000100:00100000:1.0:1789265329.117102:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 238 00000100:00100000:1.0:1789265329.117115:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102eb08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+18:11264:x1876180397558144:12345-192.168.203.37@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1789265329.117244:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102eb08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+18:11264:x1876180397558144:12345-192.168.203.37@tcp:60:lhsmtool_posix.0 Request processed in 132us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265329.117252:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 238 00000100:00080000:0.0:1789265329.118002:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265329.119277:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265329.119384:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397558400 00000100:00100000:0.0:1789265329.119396:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397558400 00000100:00100000:0.0:1789265329.119463:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 65 00000100:00100000:0.0:1789265329.119474:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102eb0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+18:11264:x1876180397558400:12345-192.168.203.37@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789265329.119902:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102eb0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+19:11264:x1876180397558400:12345-192.168.203.37@tcp:35:lhsmtool_posix.0 Request processed in 429us (634us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1789265329.119911:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 65 00000100:00100000:3.0:1789265329.302411:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265329.302620:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397558528 00000100:00100000:2.0:1789265329.302632:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397558528 00000100:00100000:2.0:1789265329.302717:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 239 00000100:00100000:2.0:1789265329.302727:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103fc40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+5:12063:x1876180397558528:12345-192.168.203.37@tcp:101:lsof.0 00010000:00010000:2.0:1789265329.302749:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265329.302779:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb952e69 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f016a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265329.302842:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952e70 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265329.302858:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952e70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265329.302873:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952e70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265329.302917:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789265329.302929:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789265329.302951:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952e70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265329.302975:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6c00/0x27274ba5bb952e69 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f016a expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265329.303011:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952e70 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f016a expref: 6 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265329.303020:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1012931100) 00010000:00010000:2.0:1789265329.303023:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789265329.303026:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fad7a00, rc 0) 00000100:00100000:2.0:1789265329.303135:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103fc40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+6:12063:x1876180397558528:12345-192.168.203.37@tcp:101:lsof.0 Request processed in 410us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265329.303144:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 239 00000100:00080000:0.0:1789265329.303274:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789265329.458647:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265330.483371:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265330.994347:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789265330.994371:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103fc42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414314368:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789265330.994452:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265330.994572:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414314368 00000100:00100000:2.0:1789265330.994581:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414314368 00000100:00100000:2.0:1789265330.994643:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789265330.994651:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103b822850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414314368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789265330.994683:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789265330.994727:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103b822850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414314368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265330.994735:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:0.0:1789265330.994990:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265330.995027:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103fc42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414314368:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789265331.506365:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265332.018519:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103fc40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876180414314624:0@lo:400:kworker.0 00000100:00100000:0.0:1789265332.018579:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103fc41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:871daf34-1206-40e7-bd71-78303abe4d37:3316:1876180414314496:0@lo:400:kworker.0 00000100:00100000:3.0:1789265332.018619:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265332.018637:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265332.018779:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103fc42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1876180414314752:0@lo:400:kworker.0 00000100:00100000:2.0:1789265332.018817:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265332.018973:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103fc42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414315136:0@lo:400:kworker.0 00000100:00100000:3.0:1789265332.019006:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265332.019059:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414314624 00000100:00100000:3.0:1789265332.019068:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414314624 00000100:00100000:3.0:1789265332.019149:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414314752 00000100:00100000:3.0:1789265332.019153:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414314752 00000100:00100000:3.0:1789265332.019192:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789265332.019201:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103fc43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876180414314624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265332.019265:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103fc43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876180414314624:12345-0@lo:400:kworker.0 Request processed in 65us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265332.019272:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789265332.019292:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789265332.019303:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102eb09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1876180414314752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265332.019333:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102eb09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1876180414314752:12345-0@lo:400:kworker.0 Request processed in 36us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265332.019339:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789265332.019360:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414314496 00000100:00100000:3.0:1789265332.019383:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414314496 00000100:00100000:3.0:1789265332.019414:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1789265332.019420:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+19:3316:x1876180414314496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265332.019453:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:871daf34-1206-40e7-bd71-78303abe4d37+19:3316:x1876180414314496:12345-0@lo:400:kworker.0 Request processed in 33us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265332.019459:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1789265332.019490:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414315136 00000100:00100000:3.0:1789265332.019494:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414315136 00000100:00100000:3.0:1789265332.019525:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789265332.019532:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103fc40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1876180414315136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265332.019562:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103fc40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1876180414315136:12345-0@lo:400:kworker.0 Request processed in 30us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265332.019567:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789265332.019614:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103fc40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876180414314624:0@lo:400:kworker.0 00000100:00100000:3.0:1789265332.019626:0:3317:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:3.0:1789265332.019633:0:3317:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:3.0:1789265332.019656:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103fc42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414315136:0@lo:400:kworker.0 00000100:00100000:3.0:1789265332.019719:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103fc42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1876180414314752:0@lo:400:kworker.0 00000100:00080000:3.0:1789265332.019768:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789265332.019774:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265332.020053:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103fc41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:871daf34-1206-40e7-bd71-78303abe4d37:3316:1876180414314496:0@lo:400:kworker.0 00000100:00100000:1.0:1789265332.020100:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103fc40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414314880:0@lo:400:kworker.0 00000100:00100000:0.0:1789265332.020102:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103fc40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1876180414315008:0@lo:400:kworker.0 00000100:00100000:0.0:1789265332.020156:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265332.020157:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265332.020212:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414314880 00000100:00100000:0.0:1789265332.020217:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414314880 00000100:00100000:0.0:1789265332.020277:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789265332.020286:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02e33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414314880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265332.020332:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02e33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414314880:12345-0@lo:400:kworker.0 Request processed in 48us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265332.020351:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789265332.020831:0:11857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414315008 00000100:00100000:3.0:1789265332.020838:0:11857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414315008 00000100:00080000:1.0:1789265332.021030:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789265332.021035:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265332.021070:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103fc40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414314880:0@lo:400:kworker.0 00000100:00100000:3.0:1789265332.021428:0:11857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789265332.021441:0:11857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102eecf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876180414315008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265332.021526:0:11857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102eecf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876180414315008:12345-0@lo:400:kworker.0 Request processed in 89us (1373us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265332.021550:0:11857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789265332.022585:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103fc40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1876180414315008:0@lo:400:kworker.0 00000001:00080000:1.0:1789265332.099297:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:1.0:1789265332.099324:0:5863:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1789265332.099420:0:5874:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1789265332.099434:0:5874:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:2.0:1789265332.470657:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265332.470722:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265332.470769:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265332.470799:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265332.470828:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265332.470863:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397559040 00000100:00100000:2.0:1789265332.470892:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397559040 00000100:00100000:2.0:1789265332.470973:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397558912 00000100:00100000:2.0:1789265332.470976:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397558912 00000100:00100000:2.0:1789265332.471012:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 96 00000100:00100000:2.0:1789265332.471023:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c07b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+7:2349:x1876180397559040:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789265332.471161:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c07b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+7:2349:x1876180397559040:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 138us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265332.471169:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 96 00000100:00100000:2.0:1789265332.471189:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 97 00000100:00100000:2.0:1789265332.471196:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c079c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+5:2349:x1876180397558912:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789265332.471222:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c079c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+5:2349:x1876180397558912:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 27us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265332.471228:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 97 00000100:00100000:2.0:1789265332.471246:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397558784 00000100:00100000:2.0:1789265332.471249:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397558784 00000100:00100000:2.0:1789265332.471279:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397559168 00000100:00100000:2.0:1789265332.471282:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397559168 00000100:00100000:2.0:1789265332.471302:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 155 00000100:00100000:2.0:1789265332.471309:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c07b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+18:2349:x1876180397558784:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789265332.471561:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c07b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+18:2349:x1876180397558784:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 251us (919us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265332.471568:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 155 00000100:00100000:2.0:1789265332.471582:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 156 00000100:00100000:2.0:1789265332.471588:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+6:2349:x1876180397559168:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789265332.471614:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+6:2349:x1876180397559168:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 26us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265332.471630:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 156 00000100:00080000:2.0:1789265332.471651:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789265332.471656:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789265332.471659:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789265332.472404:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397558656 00000100:00100000:1.0:1789265332.472415:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397558656 00000100:00100000:1.0:1789265332.472534:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 297 00000100:00100000:1.0:1789265332.472545:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+13:2349:x1876180397558656:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789265332.472610:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+13:2349:x1876180397558656:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 67us (1839us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265332.472618:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 297 00010000:00010000:3.0:1789265332.531204:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265332.535583:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414315264:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789265332.535686:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265332.538572:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414315264 00000100:00100000:2.0:1789265332.538588:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414315264 00000100:00100000:2.0:1789265332.538655:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789265332.538666:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103fc42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876180414315264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789265332.538708:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789265332.538803:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103fc42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876180414315264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 138us (3116us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265332.538810:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789265332.538949:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414315264:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1789265333.458518:0:12706:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 22:08:51 (1789265331) 00010000:00010000:3.0:1789265333.555303:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265334.580564:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265335.603760:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265336.114485:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789265336.114509:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103fc42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414315392:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789265336.114578:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265336.114844:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414315392 00000100:00100000:3.0:1789265336.114853:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414315392 00000100:00100000:3.0:1789265336.114940:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789265336.114950:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102eecfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414315392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789265336.114984:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789265336.115030:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102eecfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414315392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265336.115037:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:0.0:1789265336.115424:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265336.115569:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103fc42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414315392:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1789265336.435194:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789265336.435206:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789265336.440301:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1789265336.440500:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1789265336.626427:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265337.139884:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02e32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414315904:0@lo:400:kworker.0 00000100:00100000:1.0:1789265337.139962:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265337.140153:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789265337.140161:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02e32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:871daf34-1206-40e7-bd71-78303abe4d37:3315:1876180414315520:0@lo:400:kworker.0 00000100:00100000:3.0:1789265337.140185:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02e33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876180414315648:0@lo:400:kworker.0 00000100:00100000:2.0:1789265337.140653:0:12007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414315904 00000100:00100000:2.0:1789265337.140662:0:12007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414315904 00000100:00100000:2.0:1789265337.140710:0:12007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789265337.140721:0:12007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02df5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414315904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265337.140813:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02e31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1876180414315776:0@lo:400:kworker.0 00000100:00100000:2.0:1789265337.142641:0:12007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02df5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414315904:12345-0@lo:400:kworker.0 Request processed in 1918us (2674us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265337.142654:0:12007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789265337.142781:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265337.142816:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414315520 00000100:00100000:2.0:1789265337.142823:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414315520 00000100:00100000:1.0:1789265337.143098:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02e30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1876180414316032:0@lo:400:kworker.0 00000100:00100000:2.0:1789265337.143110:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1789265337.143119:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+19:3315:x1876180414315520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265337.143166:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:871daf34-1206-40e7-bd71-78303abe4d37+19:3315:x1876180414315520:12345-0@lo:400:kworker.0 Request processed in 49us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265337.143173:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1789265337.143648:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265337.143684:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02df4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414316160:0@lo:400:kworker.0 00000100:00100000:3.0:1789265337.143716:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265337.143749:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414315648 00000100:00100000:3.0:1789265337.143754:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414315648 00000100:00100000:3.0:1789265337.143784:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789265337.143792:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103fc40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876180414315648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265337.143853:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103fc40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876180414315648:12345-0@lo:400:kworker.0 Request processed in 61us (1851us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265337.143861:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789265337.143894:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265337.143930:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02e32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414315904:0@lo:400:kworker.0 00000100:00100000:2.0:1789265337.144368:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02e33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876180414315648:0@lo:400:kworker.0 00000100:00100000:0.0:1789265337.144453:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414316160 00000100:00100000:0.0:1789265337.144458:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414316160 00000100:00100000:0.0:1789265337.144509:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789265337.144518:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103fc41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1876180414316160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265337.144573:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103fc41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1876180414316160:12345-0@lo:400:kworker.0 Request processed in 57us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265337.144580:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789265337.144620:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414316032 00000100:00100000:1.0:1789265337.144626:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414316032 00000100:00100000:1.0:1789265337.144658:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789265337.144667:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103fc41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876180414316032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265337.144750:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02df4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414316160:0@lo:400:kworker.0 00000100:00100000:1.0:1789265337.144950:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103fc41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876180414316032:12345-0@lo:400:kworker.0 Request processed in 284us (1054us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265337.144957:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789265337.144986:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789265337.145509:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789265337.145514:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789265337.145533:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414315776 00000100:00100000:2.0:1789265337.145539:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414315776 00000100:00100000:2.0:1789265337.145572:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789265337.145580:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02df5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1876180414315776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265337.145628:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02df5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1876180414315776:12345-0@lo:400:kworker.0 Request processed in 50us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265337.145634:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789265337.145664:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02e31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1876180414315776:0@lo:400:kworker.0 00000100:00080000:2.0:1789265337.145679:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265337.146145:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02e32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:871daf34-1206-40e7-bd71-78303abe4d37:3315:1876180414315520:0@lo:400:kworker.0 00000100:00100000:3.0:1789265337.146159:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02e30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1876180414316032:0@lo:400:kworker.0 00000100:00100000:3.0:1789265337.589500:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265337.589550:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265337.589599:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265337.589625:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397559296 00000100:00100000:0.0:1789265337.589642:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397559296 00000100:00100000:3.0:1789265337.589644:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265337.589699:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265337.589730:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 299 00000100:00100000:0.0:1789265337.589744:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1230cd-a81b-4bcc-a532-e24f5353fef4+13:2350:x1876180397559296:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789265337.589772:0:11857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397559808 00000100:00100000:0.0:1789265337.589829:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1230cd-a81b-4bcc-a532-e24f5353fef4+13:2350:x1876180397559296:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 86us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265337.589837:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 299 00000100:00100000:3.0:1789265337.589924:0:11857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397559808 00000100:00100000:3.0:1789265337.589997:0:11857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397559424 00000100:00100000:3.0:1789265337.590001:0:11857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397559424 00000100:00100000:3.0:1789265337.590026:0:11857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 160 00000100:00100000:3.0:1789265337.590036:0:11857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103fc40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+6:2350:x1876180397559808:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789265337.590105:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397559552 00000100:00100000:1.0:1789265337.590113:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397559552 00000100:00100000:1.0:1789265337.590154:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397559680 00000100:00100000:1.0:1789265337.590158:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397559680 00000100:00100000:1.0:1789265337.590198:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 100 00000100:00100000:3.0:1789265337.590206:0:11857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103fc40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+6:2350:x1876180397559808:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 168us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265337.590213:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103fc42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+5:2350:x1876180397559552:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789265337.590223:0:11857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 160 00000100:00100000:3.0:1789265337.590252:0:11857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 161 00000100:00100000:3.0:1789265337.590263:0:11857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103fc40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+18:2350:x1876180397559424:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789265337.590268:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103fc42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+5:2350:x1876180397559552:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 58us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265337.590300:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 100 00000100:00100000:1.0:1789265337.590320:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 101 00000100:00100000:1.0:1789265337.590328:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103fc41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+7:2350:x1876180397559680:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789265337.590439:0:11857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103fc40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+18:2350:x1876180397559424:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 177us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265337.590460:0:11857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 161 00000100:00080000:0.0:1789265337.590691:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789265337.590696:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789265337.590699:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265337.601401:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103fc41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+7:2350:x1876180397559680:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 11059us (11689us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265337.601418:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 101 00010000:00010000:3.0:1789265337.654616:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265337.655795:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414316288:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789265337.655907:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265337.659018:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414316288 00000100:00100000:2.0:1789265337.659038:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414316288 00000100:00100000:2.0:1789265337.659167:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789265337.659178:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02df7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876180414316288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789265337.659225:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789265337.659326:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02df7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876180414316288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 150us (3420us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265337.659332:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789265337.659967:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414316288:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789265337.665993:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265337.666407:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397560064 00000100:00100000:1.0:1789265337.666424:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397560064 00000100:00100000:1.0:1789265337.666508:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 66 00000100:00100000:1.0:1789265337.666521:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+18:12284:x1876180397560064:12345-192.168.203.37@tcp:35:umount.0 00000100:00100000:1.0:1789265337.667033:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+19:12284:x1876180397560064:12345-192.168.203.37@tcp:35:umount.0 Request processed in 512us (1054us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1789265337.667043:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 66 00000100:00100000:2.0:1789265337.669051:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265337.669773:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397560320 00000100:00100000:1.0:1789265337.669791:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397560320 00000100:00100000:1.0:1789265337.669893:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 67 00000100:00100000:1.0:1789265337.669908:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+19:12284:x1876180397560320:12345-192.168.203.37@tcp:35:umount.0 00000100:00100000:1.0:1789265337.671028:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+20:12284:x1876180397560320:12345-192.168.203.37@tcp:35:umount.0 Request processed in 1112us (1974us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1789265337.671041:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 67 00000100:00100000:2.0:1789265337.679186:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265337.679313:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397560576 00000100:00100000:0.0:1789265337.679324:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397560576 00000100:00100000:0.0:1789265337.679379:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 68 00000100:00100000:0.0:1789265337.679388:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10113fcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+20:12284:x1876180397560576:12345-192.168.203.37@tcp:35:umount.0 00000100:00100000:0.0:1789265337.679612:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10113fcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+21:12284:x1876180397560576:12345-192.168.203.37@tcp:35:umount.0 Request processed in 224us (452us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1789265337.679620:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 68 00000100:00100000:2.0:1789265337.685576:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265337.685738:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397560832 00000100:00100000:0.0:1789265337.685748:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397560832 00000100:00100000:0.0:1789265337.685810:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 69 00000100:00100000:0.0:1789265337.685820:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+21:12284:x1876180397560832:12345-192.168.203.37@tcp:35:umount.0 00000100:00100000:0.0:1789265337.686437:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+22:12284:x1876180397560832:12345-192.168.203.37@tcp:35:umount.0 Request processed in 613us (867us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1789265337.686468:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 69 00000100:00100000:2.0:1789265337.696049:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265337.696112:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265337.696142:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265337.696190:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265337.696257:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397561344 00000100:00100000:3.0:1789265337.696266:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397561344 00000100:00100000:3.0:1789265337.696334:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397561600 00000100:00100000:3.0:1789265337.696337:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397561600 00000100:00100000:3.0:1789265337.696352:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397561472 00000100:00100000:3.0:1789265337.696354:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397561472 00000100:00100000:3.0:1789265337.696371:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 19 00000100:00100000:3.0:1789265337.696381:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c1230cd-a81b-4bcc-a532-e24f5353fef4+15:2349:x1876180397561344:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265337.696396:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265337.696417:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1000030000/0x27274ba5bb951e86 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efcf5 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265337.696437:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265337.696488:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c1230cd-a81b-4bcc-a532-e24f5353fef4+14:2349:x1876180397561344:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 108us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265337.696496:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 19 00000100:00100000:3.0:1789265337.696514:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 20 00000100:00100000:3.0:1789265337.696520:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c1230cd-a81b-4bcc-a532-e24f5353fef4+13:2349:x1876180397561600:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265337.696528:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265337.696537:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a103fae9600/0x27274ba5bb9520fc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efdc0 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265337.696545:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265337.696562:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c1230cd-a81b-4bcc-a532-e24f5353fef4+12:2349:x1876180397561600:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 43us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265337.696589:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 20 00000100:00100000:3.0:1789265337.696602:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 21 00000100:00100000:3.0:1789265337.696608:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c1230cd-a81b-4bcc-a532-e24f5353fef4+11:2349:x1876180397561472:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265337.696616:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265337.696625:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1017263800/0x27274ba5bb951e4e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efcbd expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265337.696635:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265337.696651:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c1230cd-a81b-4bcc-a532-e24f5353fef4+10:2349:x1876180397561472:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 44us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265337.696658:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 21 00000100:00100000:0.0:1789265337.701606:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397561216 00000100:00100000:0.0:1789265337.701622:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397561216 00000100:00100000:0.0:1789265337.701681:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 72 00000100:00100000:0.0:1789265337.701691:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+7:2347:x1876180397561216:12345-192.168.203.37@tcp:9:umount.0 00000020:00000080:0.0:1789265337.701722:0:6682:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x27274ba5bb952428 00000020:00010000:0.0:1789265337.701729:0:6682:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8a103f9ab800: total 0 00000100:00080000:0.0:1789265337.701733:0:6682:0:(import.c:65:import_set_state_nolock()) ffff8a103f9aa000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789265337.701780:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1789265337.702070:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+5:2347:x1876180397561216:12345-192.168.203.37@tcp:9:umount.0 Request processed in 378us (6030us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265337.702103:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 72 00000020:00010000:3.0:1789265337.702532:0:5829:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8a103f9ab800: total 0 00010000:00010000:3.0:1789265337.702568:0:5829:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a103f9ab800, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1789265337.702627:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000038df497b/0x27274ba5bb952e62 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0163 expref: 4 pid: 8856 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265337.702663:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0b070fb/0x27274ba5bb9527c4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff95 expref: 3 pid: 12007 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265337.702678:0:5829:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a103f9ab800, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1789265337.702689:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265337.702691:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265337.702693:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265337.705446:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265337.705580:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397561728 00000100:00100000:0.0:1789265337.705589:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397561728 00000100:00100000:0.0:1789265337.705646:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 73 00000100:00100000:0.0:1789265337.705656:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02e30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+5:2347:x1876180397561728:12345-192.168.203.37@tcp:9:umount.0 00000020:00000080:0.0:1789265337.705685:0:6685:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x27274ba5bb9521c0 00000100:00080000:0.0:1789265337.705696:0:6685:0:(import.c:65:import_set_state_nolock()) ffff8a10052cc800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789265337.705745:0:6685:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1789265337.706022:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02e30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+2:2347:x1876180397561728:12345-192.168.203.37@tcp:9:umount.0 Request processed in 366us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265337.706031:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 73 00010000:00010000:1.0:1789265337.706399:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265337.722414:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265337.722513:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397562752 00000100:00100000:2.0:1789265337.722525:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397562752 00000100:00100000:2.0:1789265337.722589:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 240 00000100:00100000:2.0:1789265337.722601:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102eecf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+22:2347:x1876180397562752:12345-192.168.203.37@tcp:39:umount.0 00000020:00000080:2.0:1789265337.722635:0:5842:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x27274ba5bb951e5c 00000020:00010000:2.0:1789265337.722648:0:5842:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8a0f029e3800: total 0 00000100:00080000:2.0:1789265337.722653:0:5842:0:(import.c:65:import_set_state_nolock()) ffff8a103d89d800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789265337.722687:0:5842:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:2.0:1789265337.723071:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102eecf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b820fcb-1bab-4b78-bfa4-355c22a09cf8+21:2347:x1876180397562752:12345-192.168.203.37@tcp:39:umount.0 Request processed in 470us (665us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1789265337.723118:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 240 00000020:00010000:1.0:1789265337.723322:0:5829:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8a0f029e3800: total 0 00010000:00010000:1.0:1789265337.723339:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265337.723379:0:5829:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a0f029e3800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1789265337.723412:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a1002ca3700) 00010000:00010000:1.0:1789265337.723415:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789265337.723424:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35c00/0x27274ba5bb952e23 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f014e expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265337.723444:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1012931100) 00010000:00010000:1.0:1789265337.723447:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789265337.723452:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6400/0x27274ba5bb952826 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99effb1 expref: 19 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265337.723465:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a1032d00f00) 00010000:00010000:1.0:1789265337.723468:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265337.723472:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae9800/0x27274ba5bb952142 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efdd5 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265337.723488:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a1012931800) 00010000:00010000:1.0:1789265337.723491:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789265337.723495:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7600/0x27274ba5bb952785 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff80 expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265337.723507:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8a1012931500) 00010000:00010000:1.0:1789265337.723509:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789265337.723513:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6e00/0x27274ba5bb952126 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efdce expref: 16 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265337.723526:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a1012931800) 00010000:00010000:1.0:1789265337.723529:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789265337.723547:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34600/0x27274ba5bb9527af lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff8e expref: 15 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265337.723562:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a1002ca3700) 00010000:00010000:1.0:1789265337.723565:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789265337.723568:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad6a00/0x27274ba5bb952e4d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f015c expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265337.723580:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a101cdf4400) 00010000:00010000:1.0:1789265337.723583:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789265337.723587:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596400/0x27274ba5bb952842 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99effb8 expref: 13 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265337.723598:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a101cdf4400) 00010000:00010000:1.0:1789265337.723600:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789265337.723603:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fae8e00/0x27274ba5bb952b21 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f008a expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265337.723618:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a101b706300) 00010000:00010000:1.0:1789265337.723620:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789265337.723623:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1017263c00/0x27274ba5bb952196 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efdea expref: 11 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265337.723635:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a1002ca3700) 00010000:00010000:1.0:1789265337.723637:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789265337.723640:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596e00/0x27274ba5bb952d43 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0116 expref: 10 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265337.723654:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a101b706300) 00010000:00010000:1.0:1789265337.723661:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789265337.723666:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597000/0x27274ba5bb952483 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efebc expref: 9 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265337.723681:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a1012931800) 00010000:00010000:1.0:1789265337.723683:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789265337.723687:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35600/0x27274ba5bb9526a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99eff48 expref: 8 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265337.723698:0:5829:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a0f029e3800, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1789265337.723709:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265337.723711:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265337.723713:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265338.675367:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789265339.241690:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4b820fcb-1bab-4b78-bfa4-355c22a09cf8 00000020:00000080:3.0:1789265339.241699:0:6708:0:(genops.c:885:class_export_put()) final put ffff8a10052c9000/4b820fcb-1bab-4b78-bfa4-355c22a09cf8 00000020:00000080:1.0:1789265339.241845:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a10052c9000/4b820fcb-1bab-4b78-bfa4-355c22a09cf8 for lustre-OST0000 00000020:00000080:1.0:1789265339.241906:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a10052cc800 for lustre-OST0000 00000100:00100000:2.0:1789265339.666893:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265339.666935:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265339.666973:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265339.667168:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397562880 00000100:00100000:0.0:1789265339.667177:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397562880 00000100:00100000:0.0:1789265339.667239:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397563008 00000100:00100000:0.0:1789265339.667255:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397563008 00000100:00100000:0.0:1789265339.667279:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397563136 00000100:00100000:0.0:1789265339.667282:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397563136 00000100:00100000:0.0:1789265339.667296:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 22 00000100:00100000:0.0:1789265339.667305:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02e32300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+12:2348:x1876180397562880:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265339.667320:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265339.667338:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1042045200/0x27274ba5bb951f2e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efd0a expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265339.667357:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265339.667410:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02e32300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+11:2348:x1876180397562880:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 106us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265339.667417:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 22 00000100:00100000:0.0:1789265339.667443:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 23 00000100:00100000:0.0:1789265339.667449:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02e32d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+10:2348:x1876180397563008:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265339.667458:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265339.667466:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1017263200/0x27274ba5bb951f35 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efd34 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265339.667475:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265339.667490:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02e32d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+9:2348:x1876180397563008:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 42us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265339.667496:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 23 00000100:00100000:0.0:1789265339.667520:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 24 00000100:00100000:0.0:1789265339.667527:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02e31500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+8:2348:x1876180397563136:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265339.667534:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265339.667541:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a103fae8a00/0x27274ba5bb9520f5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efdb9 expref: 8 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265339.667555:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265339.667572:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02e31500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c1230cd-a81b-4bcc-a532-e24f5353fef4+7:2348:x1876180397563136:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 46us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265339.667577:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 24 00000100:00100000:0.0:1789265339.675564:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265339.677869:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397563392 00000100:00100000:3.0:1789265339.677914:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397563392 00000100:00100000:3.0:1789265339.678747:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 241 00000100:00100000:3.0:1789265339.678767:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102eecc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+6:2347:x1876180397563392:12345-192.168.203.37@tcp:39:umount.0 00000020:00000080:3.0:1789265339.678826:0:5840:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x27274ba5bb951f43 00000020:00010000:3.0:1789265339.678836:0:5840:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8a0f01b63800: total 0 00000100:00080000:3.0:1789265339.678842:0:5840:0:(import.c:65:import_set_state_nolock()) ffff8a0f01b65000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789265339.678881:0:5840:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:3.0:1789265339.679452:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102eecc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:477585d4-0dee-4ce9-beb5-a40b2f26e8a4+5:2347:x1876180397563392:12345-192.168.203.37@tcp:39:umount.0 Request processed in 690us (3898us total) trans 4294967527 rc 0/0 00000100:00100000:3.0:1789265339.679462:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 241 00000020:00010000:1.0:1789265339.679752:0:5829:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8a0f01b63800: total 0 00010000:00010000:1.0:1789265339.679806:0:5829:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a0f01b63800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789265339.679846:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1012931100) 00010000:00010000:1.0:1789265339.679861:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789265339.679871:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fad7a00/0x27274ba5bb952e70 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f016a expref: 4 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265339.679897:0:5829:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a0f01b63800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1789265339.679907:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265339.679909:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265339.679911:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789265339.684006:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789265339.698416:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265339.707091:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265339.707221:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397563648 00000100:00100000:2.0:1789265339.707235:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397563648 00000100:00100000:2.0:1789265339.707303:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 300 00000100:00100000:2.0:1789265339.707314:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1230cd-a81b-4bcc-a532-e24f5353fef4+7:2347:x1876180397563648:12345-192.168.203.37@tcp:251:umount.0 00000020:00000080:2.0:1789265339.707377:0:5833:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x27274ba5bb951e39 00000020:00010000:2.0:1789265339.707407:0:5833:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8a0f029e4000: total 0 00000100:00080000:2.0:1789265339.707413:0:5833:0:(import.c:65:import_set_state_nolock()) ffff8a0f029e0000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789265339.707978:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1230cd-a81b-4bcc-a532-e24f5353fef4+3:2347:x1876180397563648:12345-192.168.203.37@tcp:251:umount.0 Request processed in 663us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265339.707988:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 300 00000020:00010000:1.0:1789265339.709404:0:5829:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8a0f029e4000: total 0 00010000:00010000:1.0:1789265339.709434:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265339.709493:0:5829:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a0f029e4000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789265339.709540:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1000030e00/0x27274ba5bb951e8d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99efcfc expref: 2 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265339.709563:0:5829:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a0f029e4000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1789265339.709573:0:5829:0:(genops.c:885:class_export_put()) final put ffff8a0f029e4000/1c1230cd-a81b-4bcc-a532-e24f5353fef4 00010000:00010000:1.0:1789265339.709586:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265339.709588:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265339.709590:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789265339.709662:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a0f029e4000/1c1230cd-a81b-4bcc-a532-e24f5353fef4 for MGS 00000020:00000080:0.0:1789265339.709715:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a0f029e0000 for MGS 00010000:00010000:2.0:1789265340.728773:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265341.237539:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789265341.237575:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102eecc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414316416:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789265341.237682:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265341.238009:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414316416 00000100:00100000:2.0:1789265341.238034:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414316416 00000100:00100000:2.0:1789265341.238151:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789265341.238164:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102eecf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414316416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789265341.238211:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789265341.238292:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102eecf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414316416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265341.238300:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789265341.238362:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102eecc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414316416:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789265341.238717:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:01000004:3.0:1789265341.678529:0:12903:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1789265341.709791:0:12903:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1789265341.709874:0:12903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a1042045a00/0x27274ba5bb951eef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951ef6 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265341.709892:0:12903:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a1042045a00/0x27274ba5bb951eef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x27274ba5bb951ef6 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265341.709899:0:12903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a1042045a00/0x27274ba5bb951eef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x27274ba5bb951ef6 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265341.709906:0:12903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.137@tcp lock: ffff8a1042045a00/0x27274ba5bb951eef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x27274ba5bb951ef6 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265341.709970:0:12903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789265341.709977:0:12903:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789265341.710009:0:12903:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789265341.710034:0:12903:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789265341.710043:0:12903:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00010000:00010000:1.0:1789265341.710394:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265341.710404:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff8a1042045a00/0x27274ba5bb951eef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x27274ba5bb951ef6 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265341.710413:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1042045a00 already unused, calling callback (ffffffffc1ba2c20) 10000000:00010000:1.0:1789265341.710417:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff8a1042045a00/0x27274ba5bb951eef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x27274ba5bb951ef6 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265341.710426:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff8a1042045a00/0x27274ba5bb951eef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x27274ba5bb951ef6 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265341.710434:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff8a1042045a00/0x27274ba5bb951eef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x27274ba5bb951ef6 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265341.710439:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789265341.710442:0:5829:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789265341.710445:0:5829:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789265341.710483:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff8a1042045a00/0x27274ba5bb951eef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x27274ba5bb951ef6 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265341.710501:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789265341.710755:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02df6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:871daf34-1206-40e7-bd71-78303abe4d37:3316:1876180414316544:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789265341.710860:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789265341.710950:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff8a1042045a00/0x27274ba5bb951eef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x27274ba5bb951ef6 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265341.710960:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff8a1042045a00/0x27274ba5bb951eef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x27274ba5bb951ef6 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265341.710976:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265341.710979:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265341.710981:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789265341.711095:0:12903:0:(import.c:65:import_set_state_nolock()) ffff8a103c0c1800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1789265341.711127:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102eecce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876180414316672:0@lo:39:umount.0 00000100:00100000:0.0:1789265341.711166:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265341.711215:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414316672 00000100:00100000:0.0:1789265341.711224:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414316672 00000100:00100000:0.0:1789265341.711456:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1789265341.711467:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102eecc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876180414316672:12345-0@lo:39:umount.0 00000020:00000080:0.0:1789265341.711500:0:7934:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x27274ba5bb951c48 00000100:00080000:0.0:1789265341.711509:0:7934:0:(import.c:65:import_set_state_nolock()) ffff8a103cd2c800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1789265341.711685:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102eecc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3314:x1876180414316672:12345-0@lo:39:umount.0 Request processed in 219us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265341.711693:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:0.0:1789265341.711705:0:7934:0:(genops.c:885:class_export_put()) final put ffff8a103c0c4800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:0.0:1789265341.711755:0:3314:0:(import.c:65:import_set_state_nolock()) ffff8a103c0c1800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789265341.711766:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102eecce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876180414316672:0@lo:39:umount.0 00000020:00000080:0.0:1789265341.711793:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a103c0c4800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1789265341.711858:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a103cd2c800 for lustre-MDT0000 00000100:00080000:0.0:1789265341.711887:0:12903:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789265341.711891:0:12903:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789265341.711896:0:12903:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:3.0:1789265341.716112:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414316544 00000100:00100000:3.0:1789265341.716136:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414316544 00000100:00100000:3.0:1789265341.716235:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789265341.716249:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10118e7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:871daf34-1206-40e7-bd71-78303abe4d37+19:3316:x1876180414316544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789265341.716282:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265341.716308:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a103fad7200/0x27274ba5bb951ef6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x27274ba5bb951eef expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265341.716329:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265341.716439:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10118e7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:871daf34-1206-40e7-bd71-78303abe4d37+18:3316:x1876180414316544:12345-0@lo:103:ldlm_bl.0 Request processed in 194us (5578us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265341.716447:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789265341.716552:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02df6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:871daf34-1206-40e7-bd71-78303abe4d37:3316:1876180414316544:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789265341.718659:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265341.718799:0:12903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a1017262000/0x27274ba5bb951efd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951f04 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265341.718818:0:12903:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a1017262000/0x27274ba5bb951efd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x27274ba5bb951f04 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265341.718907:0:12903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a1017262000/0x27274ba5bb951efd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x27274ba5bb951f04 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265341.718915:0:12903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.137@tcp lock: ffff8a1017262000/0x27274ba5bb951efd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x27274ba5bb951f04 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265341.719211:0:12903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789265341.719219:0:12903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a1017263600/0x27274ba5bb951df3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951dfa expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265341.719226:0:12903:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a1017263600/0x27274ba5bb951df3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27274ba5bb951dfa expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265341.719234:0:12903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a1017263600/0x27274ba5bb951df3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x27274ba5bb951dfa expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265341.719244:0:12903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.137@tcp lock: ffff8a1017263600/0x27274ba5bb951df3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x27274ba5bb951dfa expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265341.719252:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265341.719264:0:12903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789265341.719269:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff8a1017262000/0x27274ba5bb951efd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x27274ba5bb951f04 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265341.719277:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1017262000 already unused, calling callback (ffffffffc1ba2c20) 10000000:00010000:1.0:1789265341.719282:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff8a1017262000/0x27274ba5bb951efd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x27274ba5bb951f04 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265341.719291:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff8a1017262000/0x27274ba5bb951efd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x27274ba5bb951f04 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265341.719298:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff8a1017262000/0x27274ba5bb951efd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x27274ba5bb951f04 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.719360:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:1.0:1789265341.719373:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789265341.719376:0:5829:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1789265341.719421:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff8a1017262000/0x27274ba5bb951efd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x27274ba5bb951f04 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265341.719440:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789265341.719477:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff8a1017262000/0x27274ba5bb951efd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x27274ba5bb951f04 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265341.719484:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff8a1017262000/0x27274ba5bb951efd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x27274ba5bb951f04 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265341.719500:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265341.719502:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265341.719507:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265341.719529:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02df5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:871daf34-1206-40e7-bd71-78303abe4d37:3317:1876180414316800:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789265341.719623:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789265341.719765:0:12903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a103fae9e00/0x27274ba5bb9520e7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb9520ee expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265341.719776:0:12903:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a103fae9e00/0x27274ba5bb9520e7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x27274ba5bb9520ee expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265341.719782:0:12903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a103fae9e00/0x27274ba5bb9520e7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x27274ba5bb9520ee expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265341.719800:0:12903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.137@tcp lock: ffff8a103fae9e00/0x27274ba5bb9520e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x27274ba5bb9520ee expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265341.719814:0:12903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789265341.719821:0:12903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a10421eae00/0x27274ba5bb951ba7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951bae expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265341.719827:0:12903:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a10421eae00/0x27274ba5bb951ba7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27274ba5bb951bae expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265341.719833:0:12903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a10421eae00/0x27274ba5bb951ba7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x27274ba5bb951bae expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265341.719850:0:12903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.137@tcp lock: ffff8a10421eae00/0x27274ba5bb951ba7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x27274ba5bb951bae expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265341.719859:0:12903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1789265341.719864:0:12903:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1789265341.719869:0:12903:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1789265341.719906:0:12903:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1789265341.719911:0:12903:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1789265341.719917:0:12903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789265341.719924:0:12903:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00000020:00080000:0.0:1789265341.719930:0:12903:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8a103fbdd800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789265341.719936:0:12903:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8a1037e69000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789265341.719944:0:12903:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8a0f01b63800 477585d4-0dee-4ce9-beb5-a40b2f26e8a4 192.168.203.37@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789265341.719950:0:12903:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8a0f029e3800 4b820fcb-1bab-4b78-bfa4-355c22a09cf8 192.168.203.37@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967521 stale:0 00000020:00080000:0.0:1789265341.719965:0:12903:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff8a10118f4d28) has exports, disconnecting them 00000020:00080000:0.0:1789265341.719969:0:12903:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8a103fbdd800), last request at 1789265337 00000020:00000080:0.0:1789265341.719978:0:12903:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x27274ba5bb951dbb 00000100:00080000:0.0:1789265341.719998:0:12903:0:(import.c:65:import_set_state_nolock()) ffff8a103fbdb000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789265341.720049:0:12903:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a103fbdd800): rc 0 00000020:00000080:0.0:1789265341.720051:0:12903:0:(genops.c:885:class_export_put()) final put ffff8a103fbdd800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1789265341.720062:0:12903:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8a1037e69000), last request at 1789265337 00000020:00000080:0.0:1789265341.720066:0:12903:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x27274ba5bb951cf0 00000100:00080000:0.0:1789265341.720094:0:12903:0:(import.c:65:import_set_state_nolock()) ffff8a1037e6c800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789265341.720103:0:12903:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a1037e69000): rc 0 00000020:00000080:0.0:1789265341.720104:0:12903:0:(genops.c:885:class_export_put()) final put ffff8a1037e69000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:0.0:1789265341.720113:0:12903:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa47543f23ae0 00000100:00080000:0.0:1789265341.720140:0:12903:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789265341.720143:0:12903:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:0.0:1789265341.720157:0:12903:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1789265341.720235:0:12903:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1789265341.720256:0:12903:0:(import.c:65:import_set_state_nolock()) ffff8a1037ed1800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1789265341.720351:0:12903:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789265341.720355:0:12903:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:0.0:1789265341.720368:0:12903:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789265341.720436:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102eecce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1876180414316928:0@lo:9:umount.0 00000100:00100000:0.0:1789265341.720488:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789265341.720648:0:12903:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1789265341.720661:0:12903:0:(import.c:65:import_set_state_nolock()) ffff8a103fac0800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1789265341.720679:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102eb0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1876180414317056:0@lo:9:umount.0 00000100:00100000:0.0:1789265341.720710:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265341.720743:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414316928 00000100:00100000:0.0:1789265341.720760:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414316928 00000100:00100000:0.0:1789265341.720811:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414317056 00000100:00100000:0.0:1789265341.720815:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414317056 00000100:00100000:0.0:1789265341.720860:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789265341.720870:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102eecd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876180414316928:12345-0@lo:9:umount.0 00000020:00000080:0.0:1789265341.720896:0:6682:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x27274ba5bb951d3d 00000100:00080000:0.0:1789265341.720903:0:6682:0:(import.c:65:import_set_state_nolock()) ffff8a1037e6b000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789265341.720932:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:2.0:1789265341.721451:0:12904:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789265341.721460:0:12904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff8a103fae9e00/0x27274ba5bb9520e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x27274ba5bb9520ee expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.721470:0:12904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fae9e00 already unused, calling callback (ffffffffc1ba2c20) 10000000:00010000:2.0:1789265341.721475:0:12904:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff8a103fae9e00/0x27274ba5bb9520e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x27274ba5bb9520ee expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.721485:0:12904:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff8a103fae9e00/0x27274ba5bb9520e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x27274ba5bb9520ee expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265341.721492:0:12904:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff8a103fae9e00/0x27274ba5bb9520e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x27274ba5bb9520ee expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265341.721507:0:12904:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789265341.721521:0:12904:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789265341.721526:0:12904:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789265341.721549:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff8a1017263600/0x27274ba5bb951df3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x27274ba5bb951dfa expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.721557:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1017263600 already unused, calling callback (ffffffffc1ba2c20) 10000000:00010000:2.0:1789265341.721559:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff8a1017263600/0x27274ba5bb951df3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x27274ba5bb951dfa expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.721567:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff8a1017263600/0x27274ba5bb951df3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x27274ba5bb951dfa expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265341.721574:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff8a1017263600/0x27274ba5bb951df3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x27274ba5bb951dfa expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265341.721579:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1789265341.721581:0:5828:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1789265341.721583:0:5828:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1789265341.721605:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff8a1017263600/0x27274ba5bb951df3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x27274ba5bb951dfa expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.721613:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265341.721627:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff8a1017263600/0x27274ba5bb951df3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x27274ba5bb951dfa expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.721633:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff8a1017263600/0x27274ba5bb951df3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x27274ba5bb951dfa expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.721651:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265341.721662:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff8a10421eae00/0x27274ba5bb951ba7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x27274ba5bb951bae expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.721668:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a10421eae00 already unused, calling callback (ffffffffc1ba2c20) 10000000:00010000:2.0:1789265341.721671:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff8a10421eae00/0x27274ba5bb951ba7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x27274ba5bb951bae expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.721678:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff8a10421eae00/0x27274ba5bb951ba7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x27274ba5bb951bae expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265341.721685:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff8a10421eae00/0x27274ba5bb951ba7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x27274ba5bb951bae expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265341.721690:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1789265341.721693:0:5828:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1789265341.721695:0:5828:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1789265341.721708:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff8a10421eae00/0x27274ba5bb951ba7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x27274ba5bb951bae expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.721714:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265341.721735:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff8a10421eae00/0x27274ba5bb951ba7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x27274ba5bb951bae expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.721742:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff8a10421eae00/0x27274ba5bb951ba7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x27274ba5bb951bae expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.721757:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265341.721759:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265341.721762:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265341.721769:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789265341.721784:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02e32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:871daf34-1206-40e7-bd71-78303abe4d37:3316:1876180414317312:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789265341.721867:0:12904:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff8a103fae9e00/0x27274ba5bb9520e7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x27274ba5bb9520ee expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.721874:0:12904:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265341.721884:0:12904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff8a103fae9e00/0x27274ba5bb9520e7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x27274ba5bb9520ee expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.721890:0:12904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff8a103fae9e00/0x27274ba5bb9520e7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x27274ba5bb9520ee expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.721903:0:12904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265341.721905:0:12904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265341.721906:0:12904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265341.722169:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102eecd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3314:x1876180414316928:12345-0@lo:9:umount.0 Request processed in 1298us (1679us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265341.722180:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789265341.722211:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789265341.722222:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1016d47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876180414317056:12345-0@lo:9:umount.0 00000020:00000080:0.0:1789265341.722244:0:6682:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x27274ba5bb951e2b 00000100:00080000:0.0:1789265341.722253:0:6682:0:(import.c:65:import_set_state_nolock()) ffff8a0f029e2000 : changing import state from FULL to CLOSED 00000100:00080000:2.0:1789265341.722408:0:3314:0:(import.c:65:import_set_state_nolock()) ffff8a1037ed1800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789265341.722422:0:3314:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789265341.722425:0:3314:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789265341.722428:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102eecce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1876180414316928:0@lo:9:umount.0 00000001:00000004:0.0:1789265341.722486:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1789265341.722632:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265341.722679:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789265341.722688:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02e33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:871daf34-1206-40e7-bd71-78303abe4d37:3317:1876180414317184:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789265341.722796:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1016d47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3314:x1876180414317056:12345-0@lo:9:umount.0 Request processed in 577us (2083us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265341.722805:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1789265341.722808:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789265341.722817:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789265341.722825:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02e32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:871daf34-1206-40e7-bd71-78303abe4d37:3315:1876180414317440:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789265341.722855:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265341.722866:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789265341.722874:0:3314:0:(import.c:65:import_set_state_nolock()) ffff8a103fac0800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1789265341.722884:0:3314:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1789265341.722886:0:3314:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789265341.722889:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102eb0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1876180414317056:0@lo:9:umount.0 00000020:00000080:0.0:1789265341.722929:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a103fbdd800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00080000:1.0:1789265341.722935:0:12903:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8a10118f4d28) has no exports 00000020:00000080:0.0:1789265341.722981:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1037e69000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1789265341.723009:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a103fbdb000 for lustre-MDT0000 00000020:00000080:0.0:1789265341.723015:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1037e6c800 for lustre-MDT0000 00000100:00100000:3.0:1789265341.723312:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414316800 00000100:00100000:3.0:1789265341.723326:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414316800 00000100:00100000:3.0:1789265341.723373:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414317312 00000100:00100000:3.0:1789265341.723376:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414317312 00000100:00100000:2.0:1789265341.723400:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789265341.723410:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02df7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:871daf34-1206-40e7-bd71-78303abe4d37+19:3317:x1876180414316800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789265341.723425:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265341.723446:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a101b597600/0x27274ba5bb951f04 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x27274ba5bb951efd expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265341.723460:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265341.723476:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265341.723490:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02df7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:871daf34-1206-40e7-bd71-78303abe4d37+18:3317:x1876180414316800:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (3868us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265341.723497:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02df5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:871daf34-1206-40e7-bd71-78303abe4d37:3317:1876180414316800:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789265341.723754:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414317184 00000100:00100000:0.0:1789265341.723759:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414317184 00000100:00100000:3.0:1789265341.725399:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789265341.725428:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02e31500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:871daf34-1206-40e7-bd71-78303abe4d37+19:3316:x1876180414317312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789265341.725450:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265341.725475:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a101b596c00/0x27274ba5bb951bae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x27274ba5bb951ba7 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265341.725499:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265341.725687:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02e31500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:871daf34-1206-40e7-bd71-78303abe4d37+18:3316:x1876180414317312:12345-0@lo:103:ldlm_bl.0 Request processed in 272us (3054us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265341.725696:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789265341.725761:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02e32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:871daf34-1206-40e7-bd71-78303abe4d37:3316:1876180414317312:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789265341.726151:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265341.726205:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414317440 00000100:00100000:3.0:1789265341.726212:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414317440 00000100:00100000:3.0:1789265341.726254:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789265341.726262:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:871daf34-1206-40e7-bd71-78303abe4d37+18:3315:x1876180414317440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789265341.726342:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265341.726357:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1017262e00/0x27274ba5bb9520ee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x27274ba5bb9520e7 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265341.726368:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265341.726404:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:871daf34-1206-40e7-bd71-78303abe4d37+17:3315:x1876180414317440:12345-0@lo:103:ldlm_bl.0 Request processed in 143us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265341.726410:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789265341.726437:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02e32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:871daf34-1206-40e7-bd71-78303abe4d37:3315:1876180414317440:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789265341.727103:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789265341.727160:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789265341.727176:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1016d44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:871daf34-1206-40e7-bd71-78303abe4d37+16:3317:x1876180414317184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789265341.727189:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265341.727204:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1042044600/0x27274ba5bb951dfa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x27274ba5bb951df3 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265341.727222:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265341.727449:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1016d44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:871daf34-1206-40e7-bd71-78303abe4d37+14:3317:x1876180414317184:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (3796us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265341.727457:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789265341.727494:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02e33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:871daf34-1206-40e7-bd71-78303abe4d37:3317:1876180414317184:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1789265341.735676:0:12903:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8a10118f4d28) has no exports 00010000:00010000:2.0:1789265341.746333:0:12904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789265341.792467:0:12903:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x27274ba5bb951c02 00000020:00000080:0.0:1789265341.792483:0:12903:0:(genops.c:885:class_export_put()) final put ffff8a1016d26800/lustre-QMT0000_UUID 00000020:01000000:0.0:1789265341.792566:0:12903:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1789265341.793440:0:12903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789265341.793455:0:12903:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789265341.793460:0:12903:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8a1008f419b8) has no exports 00000020:00000080:0.0:1789265341.793779:0:12903:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x27274ba5bb951bfb 00000020:00000080:0.0:1789265341.793786:0:12903:0:(genops.c:885:class_export_put()) final put ffff8a103cd29800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789265341.794010:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1016d26800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1789265341.794435:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a103cd29800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789265341.794501:0:12903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789265341.794511:0:12903:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1789265341.794515:0:12903:0:(genops.c:885:class_export_put()) final put ffff8a103cd2a800/lustre-QMT0000_UUID 00000020:00000080:2.0:1789265341.794518:0:12903:0:(genops.c:844:class_export_destroy()) destroying export ffff8a103cd2a800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1789265341.794522:0:12903:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000100:00100000:0.0:1789265342.258364:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02df5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:871daf34-1206-40e7-bd71-78303abe4d37:3317:1876180414317568:0@lo:400:kworker.0 00000100:00100000:0.0:1789265342.258443:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265342.258509:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789265342.258516:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02df5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1876180414317696:0@lo:400:kworker.0 00000100:00100000:0.0:1789265342.258561:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265342.258575:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02df6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1876180414317824:0@lo:400:kworker.0 00000100:00100000:3.0:1789265342.258623:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265342.258667:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414317696 00000100:00100000:0.0:1789265342.258675:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414317696 00000100:00100000:0.0:1789265342.258710:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414317824 00000100:00100000:0.0:1789265342.258713:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414317824 00000100:00100000:0.0:1789265342.258738:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1789265342.258746:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1016d45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3317:x1876180414317696:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1789265342.258753:0:5840:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1789265342.258797:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1016d45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3317:x1876180414317696:12345-0@lo:400:kworker.0 Request processed in 50us (235us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789265342.258806:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1789265342.258826:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1789265342.258831:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3315:x1876180414317824:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1789265342.258849:0:5840:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1789265342.258884:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3315:x1876180414317824:12345-0@lo:400:kworker.0 Request processed in 51us (261us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789265342.258891:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:0.0:1789265342.258942:0:3317:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789265342.258948:0:3317:0:(import.c:65:import_set_state_nolock()) ffff8a1037ed0000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:00080000:2.0:1789265342.258949:0:3315:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:02000400:0.0:1789265342.258957:0:3317:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1789265342.258958:0:3315:0:(import.c:65:import_set_state_nolock()) ffff8a0f029e6800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1789265342.258965:0:3315:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1789265342.258971:0:3315:0:(import.c:65:import_set_state_nolock()) ffff8a0f029e6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789265342.258976:0:3315:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 211 00000100:00080000:2.0:1789265342.258984:0:3315:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a0f029e6800 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:2.0:1789265342.259006:0:3315:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a0f02e33b80 x1876180414317952/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789265342.259029:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02df6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1876180414317824:0@lo:400:kworker.0 00000100:00100000:2.0:1789265342.259499:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02e33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3314:1876180414317952:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1789265342.259535:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265342.259567:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414317952 00000100:00100000:2.0:1789265342.259571:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414317952 00000100:00100000:2.0:1789265342.259594:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1789265342.259599:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02e32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3314:x1876180414317952:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:2.0:1789265342.259615:0:5842:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789265342.259870:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414317568 00000100:00100000:1.0:1789265342.259876:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414317568 00000100:00100000:1.0:1789265342.259909:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1789265342.259916:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10087d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+14:3317:x1876180414317568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265342.259963:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10087d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:871daf34-1206-40e7-bd71-78303abe4d37+14:3317:x1876180414317568:12345-0@lo:400:kworker.0 Request processed in 48us (1520us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265342.259972:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00080000:0.0:1789265342.291443:0:3317:0:(import.c:65:import_set_state_nolock()) ffff8a1037ed0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789265342.291453:0:3317:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 194 00000100:00080000:0.0:1789265342.291464:0:3317:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a1037ed0000 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:0.0:1789265342.291510:0:3317:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1016d46d80 x1876180414318080/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789265342.291546:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02df5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1876180414317696:0@lo:400:kworker.0 00000100:00100000:0.0:1789265342.291598:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02df5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:871daf34-1206-40e7-bd71-78303abe4d37:3317:1876180414317568:0@lo:400:kworker.0 00000100:00100000:3.0:1789265342.295767:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1016d46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3314:1876180414318080:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1789265342.295867:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265342.297642:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02e32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3314:x1876180414317952:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 38035us (38100us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789265342.297655:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1789265342.297697:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414318080 00000100:00100000:2.0:1789265342.297705:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414318080 00000100:00100000:2.0:1789265342.297737:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1789265342.297743:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3314:x1876180414318080:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:2.0:1789265342.297760:0:5842:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1789265342.297791:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3314:x1876180414318080:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 47us (1924us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789265342.297797:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:3.0:1789265342.303268:0:3314:0:(import.c:65:import_set_state_nolock()) ffff8a0f029e6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789265342.303281:0:3314:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789265342.303288:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02e33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3314:1876180414317952:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:2.0:1789265342.303930:0:3314:0:(import.c:65:import_set_state_nolock()) ffff8a1037ed0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789265342.303936:0:3314:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789265342.303940:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1016d46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3314:1876180414318080:0@lo:38:ptlrpcd_00_02.0 00000001:00080000:1.0:1789265342.397819:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000001:00100000:1.0:1789265342.397856:0:5863:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4b820fcb-1bab-4b78-bfa4-355c22a09cf8 00000001:00080000:1.0:1789265342.397872:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:1.0:1789265342.397875:0:5863:0:(genops.c:885:class_export_put()) final put ffff8a0f029e3800/4b820fcb-1bab-4b78-bfa4-355c22a09cf8 00000001:00100000:1.0:1789265342.397894:0:5863:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 477585d4-0dee-4ce9-beb5-a40b2f26e8a4 00000001:00080000:1.0:1789265342.397899:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:1.0:1789265342.397901:0:5863:0:(genops.c:885:class_export_put()) final put ffff8a0f01b63800/477585d4-0dee-4ce9-beb5-a40b2f26e8a4 00000020:00000080:0.0:1789265342.398094:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a0f029e3800/4b820fcb-1bab-4b78-bfa4-355c22a09cf8 for lustre-MDT0000 00000020:00000080:0.0:1789265342.398155:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a0f01b63800/477585d4-0dee-4ce9-beb5-a40b2f26e8a4 for lustre-MDT0000 00000020:00000080:0.0:1789265342.398180:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a103d89d800 for lustre-MDT0000 00000020:00000080:0.0:1789265342.398185:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a0f01b65000 for lustre-MDT0000 00010000:00010000:0.0:1789265342.772978:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789265342.810552:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789265342.810561:0:7633:0:(genops.c:885:class_export_put()) final put ffff8a0f029e2800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1789265342.810584:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4b820fcb-1bab-4b78-bfa4-355c22a09cf8 00000020:00000080:2.0:1789265342.810587:0:7633:0:(genops.c:885:class_export_put()) final put ffff8a103f9ab800/4b820fcb-1bab-4b78-bfa4-355c22a09cf8 00000020:00000080:1.0:1789265342.810638:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a0f029e2800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1789265342.810680:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a103f9ab800/4b820fcb-1bab-4b78-bfa4-355c22a09cf8 for lustre-OST0001 00000020:00000080:1.0:1789265342.810699:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a0f029e2000 for lustre-OST0001 00000020:00000080:1.0:1789265342.810704:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a103f9aa000 for lustre-OST0001 00010000:00010000:1.0:1789265343.794903:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1789265343.858502:0:12903:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a10349ff540 - data ffff8a1025bded80/ffff8a102ee9b800 00000020:01000000:0.0:1789265343.858664:0:12903:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a10087b61e0 - data ffff8a102585b000/ffff8a103ce56400 00000001:00000004:0.0:1789265343.873499:0:12903:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00080000:2.0:1789265343.993495:0:12903:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789265343.993504:0:12903:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1789265343.993522:0:12903:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789265343.993524:0:12903:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789265343.993840:0:6874:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789265343.993845:0:6874:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:0.0:1789265343.993854:0:6874:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1789265343.995254:0:12903:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789265343.995346:0:12903:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1789265343.995359:0:12903:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789265343.995361:0:12903:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789265343.995691:0:8081:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789265343.995696:0:8081:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:0.0:1789265343.995704:0:8081:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1789265344.042624:0:12903:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x27274ba5bb951bca 00000020:00000080:1.0:1789265344.042637:0:12903:0:(genops.c:885:class_export_put()) final put ffff8a103c0c5800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789265344.044276:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a103c0c5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789265344.044536:0:12903:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x27274ba5bb951bdf 00000020:00000080:1.0:1789265344.044545:0:12903:0:(genops.c:885:class_export_put()) final put ffff8a103c151800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789265344.044562:0:12903:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1789265344.044569:0:12903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789265344.044578:0:12903:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789265344.044582:0:12903:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8a10118f3370) has no exports 00000020:00000080:2.0:1789265344.044681:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a103c151800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:1.0:1789265344.044933:0:12903:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1789265344.044942:0:12903:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x27274ba5bb951e1d 00000020:00000080:1.0:1789265344.044946:0:12903:0:(genops.c:885:class_export_put()) final put ffff8a0f029e0800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789265344.045539:0:12903:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1789265344.045547:0:12903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789265344.045556:0:12903:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789265344.045560:0:12903:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff8a1037ec8000) has no exports 00000020:00000080:1.0:1789265344.045567:0:12903:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x27274ba5bb951e16 00000020:00000080:1.0:1789265344.045571:0:12903:0:(genops.c:885:class_export_put()) final put ffff8a103fac2800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789265344.045782:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a0f029e0800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1789265344.045800:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a103fac2800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1789265344.046424:0:12903:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1789265344.046430:0:12903:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789265344.046444:0:12903:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:1.0:1789265344.046450:0:12903:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789265344.046452:0:12903:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789265344.046487:0:12903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789265344.046496:0:12903:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789265344.046501:0:12903:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x27274ba5bb951d36 00000020:00000080:1.0:1789265344.046506:0:12903:0:(genops.c:885:class_export_put()) final put ffff8a102e523000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789265344.046514:0:12903:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1789265344.046518:0:12903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789265344.046521:0:12903:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789265344.046524:0:12903:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8a1037eccd28) has no exports 00000020:00000080:1.0:1789265344.046529:0:12903:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x27274ba5bb951d2f 00000020:00000080:1.0:1789265344.046532:0:12903:0:(genops.c:885:class_export_put()) final put ffff8a1037ed4000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789265344.046703:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a103fac0800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1789265344.046716:0:8:0:(genops.c:885:class_export_put()) final put ffff8a0f029e1000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789265344.046719:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a0f029e1000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1789265344.046723:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789265344.046870:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a102e523000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1789265344.046875:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1037ed4000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1789265344.047970:0:12903:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1789265344.047977:0:12903:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789265344.047980:0:12903:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:0.0:1789265344.047986:0:12903:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789265344.047988:0:12903:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789265344.048055:0:12903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789265344.048064:0:12903:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789265344.048168:0:12903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789265344.048172:0:12903:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789265344.048176:0:12903:0:(genops.c:885:class_export_put()) final put ffff8a103c0c0000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789265344.048179:0:12903:0:(genops.c:844:class_export_destroy()) destroying export ffff8a103c0c0000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1789265344.048187:0:12903:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789265344.048437:0:12903:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x27274ba5bb951be6 00000020:00000080:0.0:1789265344.048452:0:12903:0:(genops.c:885:class_export_put()) final put ffff8a103c150000/lustre-MDD0000_UUID 00000020:00000080:2.0:1789265344.048924:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1037ed1800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1789265344.048932:0:8:0:(genops.c:885:class_export_put()) final put ffff8a1037ed2000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789265344.048934:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1037ed2000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1789265344.048939:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1789265344.049130:0:12903:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1789265344.049136:0:12903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789265344.049143:0:12903:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789265344.049146:0:12903:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8a10118f19b8) has no exports 00000020:00000080:0.0:1789265344.049179:0:12903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789265344.049184:0:12903:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1789265344.049189:0:12903:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x27274ba5bb951bed 00000020:00000080:0.0:1789265344.049194:0:12903:0:(genops.c:885:class_export_put()) final put ffff8a103c156000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789265344.049699:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a103c150000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1789265344.049705:0:8:0:(genops.c:885:class_export_put()) final put ffff8a103c0c2000/lustre-MDD0000_UUID 00000020:00000080:2.0:1789265344.049707:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a103c0c2000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1789265344.049712:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:0.0:1789265344.050043:0:12903:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a10202ad000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1789265344.050048:0:12903:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a10202ad000 3 00000020:01000004:0.0:1789265344.050051:0:12903:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8a10202ad000 from lustre-MDT0000 00000020:00000080:0.0:1789265344.050094:0:12903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789265344.050100:0:12903:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1789265344.050103:0:12903:0:(genops.c:885:class_export_put()) final put ffff8a103c0c7800/lustre-MDT0000_UUID 00000020:00000080:0.0:1789265344.050106:0:12903:0:(genops.c:844:class_export_destroy()) destroying export ffff8a103c0c7800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1789265344.050113:0:12903:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1789265344.050144:0:12903:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1789265344.050148:0:12903:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1789265344.050151:0:12903:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1789265344.050154:0:12903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789265344.050157:0:12903:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789265344.050175:0:12903:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8a102028f800 871daf34-1206-40e7-bd71-78303abe4d37 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789265344.050181:0:12903:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8a1008f44d28) has exports, disconnecting them 00000020:00080000:0.0:1789265344.050186:0:12903:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8a102028f800), last request at 1789265132 00000020:00000080:0.0:1789265344.050200:0:12903:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x27274ba5bb951b8b 00000020:00010000:0.0:1789265344.050204:0:12903:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8a102028f800: total 1 00000100:00080000:0.0:1789265344.050217:0:12903:0:(import.c:65:import_set_state_nolock()) ffff8a1020289000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789265344.050235:0:12903:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a102028f800): rc 0 00000020:00080000:0.0:1789265344.050238:0:12903:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8a1008f44d28) has no exports 00000020:00010000:1.0:1789265344.050346:0:12904:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8a102028f800: total 1 00010000:00010000:1.0:1789265344.050380:0:12904:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a102028f800, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1789265344.050407:0:12904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1017263000/0x27274ba5bb9520d2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x27274ba5bb9520cb expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265344.050424:0:12904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a101b596a00/0x27274ba5bb951ea2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x27274ba5bb951e9b expref: 8 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265344.050433:0:12904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a101b596800/0x27274ba5bb9520e0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x27274ba5bb9520d9 expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265344.050446:0:12904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1042044800/0x27274ba5bb951ca3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x27274ba5bb951c9c expref: 6 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265344.050458:0:12904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a101b597e00/0x27274ba5bb951f20 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x27274ba5bb951f19 expref: 5 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265344.050467:0:12904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1000030a00/0x27274ba5bb951eb0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x27274ba5bb951ea9 expref: 4 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265344.050491:0:12904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1000030400/0x27274ba5bb951ecc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x27274ba5bb951ec5 expref: 3 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265344.050500:0:12904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a101b596000/0x27274ba5bb951eda lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x27274ba5bb951ed3 expref: 2 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265344.050509:0:12904:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a102028f800, canceled 8 locks, left on hash table 0. 00000020:00000080:1.0:1789265344.050519:0:12904:0:(genops.c:885:class_export_put()) final put ffff8a102028f800/871daf34-1206-40e7-bd71-78303abe4d37 00000020:00000080:2.0:1789265344.051048:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a103c156000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:2.0:1789265344.051099:0:5833:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8a10087baa00:5833] 0 exiting: rc = 1 00010000:00010000:1.0:1789265344.051416:0:12904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265344.051419:0:12904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265344.051421:0:12904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265344.051443:0:5834:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8a1007fcf600:5834] 1 exiting: rc = 0 00000100:00100000:1.0:1789265344.051484:0:5835:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8a1010ceee00:5835] 2 exiting: rc = 0 00000020:00000080:2.0:1789265344.051544:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a102028f800/871daf34-1206-40e7-bd71-78303abe4d37 for MGS 00000020:00000080:2.0:1789265344.051575:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1020289000 for MGS 00000100:00100000:0.0:1789265344.051793:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.051801:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.051816:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.051829:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.051835:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.051842:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.051847:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.051853:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.051858:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.051864:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.051870:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.051876:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.051882:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.051887:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.051893:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.051898:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.051904:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.051909:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.051915:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.051921:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.051926:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.051932:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.051938:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.051944:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.051949:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.051954:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.051959:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.051964:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.051969:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.051975:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.051980:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.051986:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.051991:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.051996:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.052001:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.052006:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.052011:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.052023:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.052028:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.052033:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.052038:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.052043:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.052049:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.052054:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.052060:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.052065:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.052069:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.052105:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.052112:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.052117:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.052122:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.052126:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.052131:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.052136:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.052140:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.052145:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.052149:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.052155:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.052171:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.052176:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.052181:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.052186:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.052191:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.052196:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1789265344.053519:0:12903:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789265344.053525:0:12903:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:1.0:1789265344.054586:0:12903:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a10349ff720 - data ffff8a103ff08798/ffff8a102ee9a400 00000020:01000000:1.0:1789265344.054725:0:12903:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a10036cf300 - data ffff8a102b1a7e58/ffff8a100881ec00 00000020:00000080:1.0:1789265344.055595:0:12903:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x27274ba5bb951b6f 00000020:00000080:1.0:1789265344.055659:0:12903:0:(genops.c:885:class_export_put()) final put ffff8a1011946000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1789265344.055712:0:12903:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a10202ad000 from MGS, refs=2 00000020:01000004:1.0:1789265344.055717:0:12903:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a10202ad000 2 00000020:01000004:1.0:1789265344.055720:0:12903:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8a10202ad000 from MGS 00000020:00000080:1.0:1789265344.055740:0:12903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789265344.055747:0:12903:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1789265344.055750:0:12903:0:(genops.c:885:class_export_put()) final put ffff8a1011943800/MGS 00000020:00000080:1.0:1789265344.055752:0:12903:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1011943800/MGS for MGS 00000020:01000000:1.0:1789265344.055760:0:12903:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1789265344.055833:0:12903:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1789265344.055838:0:12903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789265344.055843:0:12903:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789265344.055861:0:12903:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8a103c154800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789265344.055867:0:12903:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff8a10037d4d28) has exports, disconnecting them 00000020:00080000:1.0:1789265344.055872:0:12903:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8a103c154800), last request at 1789265133 00000020:00000080:1.0:1789265344.055876:0:12903:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x27274ba5bb951c3a 00000020:00080000:1.0:1789265344.055887:0:12903:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a103c154800): rc 0 00000020:00000080:1.0:1789265344.055892:0:12903:0:(genops.c:885:class_export_put()) final put ffff8a103c154800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1789265344.055956:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1011946000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789265344.060416:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a103c154800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1789265344.061135:0:12903:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1789265344.061142:0:12903:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789265344.061146:0:12903:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789265344.061152:0:12903:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789265344.061493:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a103c0c1800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1789265344.061674:0:12903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789265344.061701:0:12903:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1789265344.061707:0:12903:0:(genops.c:885:class_export_put()) final put ffff8a103c150800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1789265344.061710:0:12903:0:(genops.c:844:class_export_destroy()) destroying export ffff8a103c150800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1789265344.061715:0:12903:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1789265344.061766:0:12903:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a10202ad000 1 00000020:00000080:0.0:1789265344.061773:0:12903:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x27274ba5bb951b61 00000020:00000080:0.0:1789265344.061779:0:12903:0:(genops.c:885:class_export_put()) final put ffff8a1011942000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1789265344.061801:0:12903:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1789265344.061806:0:12903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789265344.061813:0:12903:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789265344.061817:0:12903:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8a10118f0000) has no exports 00000020:00000080:2.0:1789265344.061935:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1011942000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789265344.142155:0:12903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789265344.142171:0:12903:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1789265344.142176:0:12903:0:(genops.c:885:class_export_put()) final put ffff8a1003111000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789265344.142181:0:12903:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1003111000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1789265344.142191:0:12903:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1789265344.142314:0:12903:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8a1005d14800 00000020:01000000:0.0:1789265344.142334:0:12903:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1789265344.142338:0:12903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789265344.142343:0:12903:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789265344.142346:0:12903:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8a1008788000) has no exports 00000100:00100000:0.0:1789265344.142414:0:11857:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff8a101879a400:11857] 4 exiting: rc = 0 00000100:00100000:0.0:1789265344.142518:0:5840:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8a1008681c00:5840] 0 exiting: rc = 1 00000100:00100000:1.0:1789265344.144613:0:5841:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8a1008680800:5841] 1 exiting: rc = 0 00000100:00100000:2.0:1789265344.144859:0:7934:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8a1034aeb600:7934] 3 exiting: rc = 0 00000100:00100000:2.0:1789265344.144924:0:5842:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8a1008681a00:5842] 2 exiting: rc = 0 00000100:00100000:0.0:1789265344.145022:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.145030:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.145036:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.145041:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.145047:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.145052:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.145058:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.145064:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.145101:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.145121:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.145126:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.145132:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.145137:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.145142:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.145147:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.145155:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.145160:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.145166:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.145172:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.145178:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.145183:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.145188:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.145193:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.145199:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.145205:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.145211:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.145217:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.145223:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.145228:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.145234:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.145239:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.145245:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.145251:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.145317:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.145323:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.145328:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.145334:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.145338:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.145343:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.145348:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.145352:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.145358:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.145363:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.145369:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.145382:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.145388:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.145393:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.145399:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.145404:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.145411:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.145416:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.145422:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.145427:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.145433:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.145438:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.145443:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.145448:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.145453:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.145460:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.145466:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.145471:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.145480:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.145486:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.145493:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.150327:0:5843:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8a10087a8200:5843] 0 exiting: rc = 1 00000100:00100000:0.0:1789265344.150515:0:5844:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8a10087b0400:5844] 1 exiting: rc = 0 00000100:00100000:1.0:1789265344.150603:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.150612:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.150618:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.150624:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.150630:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.150636:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.150642:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.150648:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.150653:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.150659:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.150665:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.150671:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.150678:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.150684:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.150690:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.150695:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.150700:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.150705:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.150711:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.150716:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.150721:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.150726:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.150731:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.150736:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.150741:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.150746:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.150764:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.150769:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.150775:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.150780:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.150785:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.150790:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.150795:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.150801:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.150807:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.150812:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.150818:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.150836:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.150842:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.150847:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.150852:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.150858:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.150863:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.150868:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.150873:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.150879:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.150884:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.150889:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.150895:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.150901:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.150906:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.150911:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.150916:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.150922:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.150927:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.150931:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.150936:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.150941:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.150945:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.150950:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.150955:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.150965:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.150970:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.150975:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.151906:0:5846:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8a10088c1400:5846] 1 exiting: rc = 0 00000100:00100000:2.0:1789265344.152038:0:5845:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8a100885c600:5845] 0 exiting: rc = 1 00000100:00100000:1.0:1789265344.152166:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.152173:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.152180:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.152185:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.152190:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.152197:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.152212:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.152219:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.152225:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.152230:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.152242:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.152252:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.152272:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.152279:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.152285:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.152290:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.152296:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.152302:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.152325:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.152333:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.152339:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.152345:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.152351:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.152357:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.152363:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.152369:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.152376:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.152384:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.152390:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.152397:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.152418:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.152425:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.152440:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.152447:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.152453:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.152459:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.152464:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.152471:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.152476:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.152481:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.152487:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.152493:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.152515:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.152522:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.152528:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.152534:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.152540:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.152547:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.152552:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.152558:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.152563:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.152569:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.152574:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.152580:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.152598:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.152605:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.152610:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.152616:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.152622:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.152628:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.152634:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.152639:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.152644:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.152655:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.161470:0:5847:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8a10088c0800:5847] 0 exiting: rc = 1 00000100:00100000:1.0:1789265344.161670:0:5848:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8a10088c1a00:5848] 1 exiting: rc = 0 00000100:00100000:0.0:1789265344.161761:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.161769:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.161774:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.161779:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.161785:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.161790:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.161795:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.161800:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.161805:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.161810:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.161816:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.161832:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.161837:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.161853:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.161858:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.161863:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.161869:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.161874:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.161879:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.161884:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.161889:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.161894:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.161899:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.161903:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.161909:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.161913:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.161918:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.161923:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.161928:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.161934:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.161939:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.161944:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.161949:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.161954:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.161960:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.161965:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.161971:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.161976:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.161981:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.161987:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.161992:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.161996:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.162002:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.162007:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.162012:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.162016:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.162021:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.162026:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.162037:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.162042:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.162046:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.162061:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.162067:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.162181:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.162188:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.162193:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.162197:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.162201:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.162206:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.162211:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.162216:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.162220:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.162226:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.162231:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.162734:0:5850:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8a10088c0a00:5850] 1 exiting: rc = 0 00000100:00100000:2.0:1789265344.163248:0:5849:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8a10088c1200:5849] 0 exiting: rc = 1 00000100:00100000:0.0:1789265344.163498:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.163504:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.163509:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.163514:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.163518:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.163523:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.163528:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.163533:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.163538:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.163543:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.163549:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.163554:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.163559:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.163564:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.163569:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.163574:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.163579:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.163584:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.163589:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.163604:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.163609:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.163614:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.163618:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.163623:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.163628:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.163633:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.163638:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.163643:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.163648:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.163652:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.163657:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.163662:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.163667:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.163672:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.163677:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.163683:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.163688:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.163693:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.163699:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.163704:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.163709:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.163714:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.163720:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.163725:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.163730:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.163735:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.163740:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.163745:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.163750:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.163756:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.163760:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.163765:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.163770:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.163776:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.163788:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.163793:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.163798:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.163803:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.163808:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.163813:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.163817:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.163833:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.163838:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.163843:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265344.165010:0:5851:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8a1033ddf000:5851] 0 exiting: rc = 1 00000100:00100000:1.0:1789265344.165412:0:5852:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8a1033dde600:5852] 1 exiting: rc = 0 00000100:00100000:2.0:1789265344.165761:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.165768:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.165773:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.165786:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.165791:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.165796:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.165802:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.165806:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.165811:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.165817:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.165833:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.165838:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.165844:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.165849:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.165854:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.165859:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.165864:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.165870:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.165875:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.165880:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.165885:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.165890:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.165896:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.165901:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.165906:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.165911:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.165916:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.165922:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.165926:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.165932:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.165936:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.165941:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.165946:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.165950:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.165956:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.165961:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.165966:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.165971:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.165983:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.165988:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.165992:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.165997:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.166002:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.166008:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.166012:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.166017:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.166023:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.166028:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.166032:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.166037:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.166042:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.166046:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.166060:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.166067:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.166205:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.166213:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.166218:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.166223:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.166227:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.166233:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.166238:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.166243:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.166248:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.166253:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265344.167066:0:5854:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8a1033ddd800:5854] 1 exiting: rc = 0 00000100:00100000:2.0:1789265344.167397:0:5855:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8a10346c7200:5855] 2 exiting: rc = 0 00000100:00100000:0.0:1789265344.167648:0:5853:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8a1033e35800:5853] 0 exiting: rc = 1 00000100:00100000:2.0:1789265344.167742:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.167749:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.167755:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.167764:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.167781:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.167788:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.167793:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.167798:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.167815:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.167830:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.167837:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.167842:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.167847:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.167854:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.167859:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.167865:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.167871:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.167877:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.167883:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.167888:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.167894:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.167899:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.167905:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.167910:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.167915:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.167920:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.167926:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.167933:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.167952:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.167960:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.167965:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.167971:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.167977:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.167982:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.167987:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.167993:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.167998:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.168003:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.168008:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.168014:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.168019:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.168024:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.168030:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.168045:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.168211:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.168220:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.168226:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.168231:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.168236:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.168241:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.168247:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.168315:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.168338:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.168345:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.168350:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.168356:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.168361:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.168366:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.168372:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.168377:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.168384:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.168389:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.168395:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265344.168401:0:12903:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1789265344.173840:0:12903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789265344.173854:0:12903:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1789265344.173860:0:12903:0:(genops.c:885:class_export_put()) final put ffff8a10090ce000/MDS_uuid 00000020:00000080:0.0:1789265344.173864:0:12903:0:(genops.c:844:class_export_destroy()) destroying export ffff8a10090ce000/MDS_uuid for MDS 00000020:01000000:0.0:1789265344.173870:0:12903:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1789265344.174018:0:12903:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00000001:00100000:2.0:1789265344.419404:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789265344.419414:0:6708:0:(genops.c:885:class_export_put()) final put ffff8a1037e68800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789265344.419693:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1037e68800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1789265344.419748:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1037e6b000 for lustre-OST0000 00010000:00010000:0.0:1789265344.818306:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265345.858610:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265346.866342:0:12904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789265347.099334:0:13057:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1789265347.113973:0:13057:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1789265347.114021:0:13057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a101b597400/0x27274ba5bb951ec5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951ecc expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265347.114036:0:13057:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a101b597400/0x27274ba5bb951ec5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x27274ba5bb951ecc expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265347.114042:0:13057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a101b597400/0x27274ba5bb951ec5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x27274ba5bb951ecc expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265347.114050:0:13057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.137@tcp lock: ffff8a101b597400/0x27274ba5bb951ec5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x27274ba5bb951ecc expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265347.114071:0:13057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789265347.114096:0:13057:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789265347.114117:0:13057:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789265347.114121:0:13057:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789265347.114127:0:13057:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789265347.114134:0:13057:0:(import.c:65:import_set_state_nolock()) ffff8a1037ed0000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1789265347.114139:0:13057:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789265347.114140:0:13057:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789265347.114144:0:13057:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789265347.114838:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265347.114847:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff8a101b597400/0x27274ba5bb951ec5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x27274ba5bb951ecc expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265347.114856:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b597400 already unused, calling callback (ffffffffc1ba2c20) 10000000:00010000:0.0:1789265347.114860:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff8a101b597400/0x27274ba5bb951ec5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x27274ba5bb951ecc expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265347.114868:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff8a101b597400/0x27274ba5bb951ec5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x27274ba5bb951ecc expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789265347.114876:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff8a101b597400/0x27274ba5bb951ec5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x27274ba5bb951ecc expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265347.114897:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789265347.114899:0:5828:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789265347.114902:0:5828:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789265347.114940:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff8a101b597400/0x27274ba5bb951ec5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x27274ba5bb951ecc expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265347.114947:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789265347.114986:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff8a101b597400/0x27274ba5bb951ec5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x27274ba5bb951ecc expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265347.114993:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff8a101b597400/0x27274ba5bb951ec5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x27274ba5bb951ecc expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265347.115006:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265347.115008:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265347.115009:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265347.115018:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789265347.115034:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1016d44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:871daf34-1206-40e7-bd71-78303abe4d37:3315:1876180414318208:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789265347.115116:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265347.115179:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414318208 00000100:00100000:0.0:1789265347.115187:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414318208 00000100:00100000:0.0:1789265347.115225:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789265347.115243:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1016d45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3315:x1876180414318208:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789265347.115250:0:8490:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789265347 with bad export cookie 2821306866759703435 00010000:00010000:1.0:1789265347.117043:0:13057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a1042045800/0x27274ba5bb951ed3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951eda expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265347.117060:0:13057:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a1042045800/0x27274ba5bb951ed3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x27274ba5bb951eda expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265347.117100:0:13057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a1042045800/0x27274ba5bb951ed3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x27274ba5bb951eda expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265347.117107:0:13057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.137@tcp lock: ffff8a1042045800/0x27274ba5bb951ed3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x27274ba5bb951eda expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265347.117131:0:13057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789265347.117152:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265347.117157:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff8a1042045800/0x27274ba5bb951ed3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x27274ba5bb951eda expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265347.117164:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1042045800 already unused, calling callback (ffffffffc1ba2c20) 10000000:00010000:1.0:1789265347.117167:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff8a1042045800/0x27274ba5bb951ed3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x27274ba5bb951eda expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265347.117176:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff8a1042045800/0x27274ba5bb951ed3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x27274ba5bb951eda expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265347.117183:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff8a1042045800/0x27274ba5bb951ed3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x27274ba5bb951eda expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265347.117188:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789265347.117190:0:5829:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:1.0:1789265347.117221:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff8a1042045800/0x27274ba5bb951ed3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x27274ba5bb951eda expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265347.117228:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789265347.117250:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff8a1042045800/0x27274ba5bb951ed3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x27274ba5bb951eda expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265347.117268:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff8a1042045800/0x27274ba5bb951ed3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x27274ba5bb951eda expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265347.117283:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265347.117285:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265347.117287:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265347.117298:0:13057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a1017262400/0x27274ba5bb9520d9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb9520e0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265347.117305:0:13057:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a1017262400/0x27274ba5bb9520d9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x27274ba5bb9520e0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265347.117312:0:13057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a1017262400/0x27274ba5bb9520d9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x27274ba5bb9520e0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265347.117318:0:13057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.137@tcp lock: ffff8a1017262400/0x27274ba5bb9520d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x27274ba5bb9520e0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265347.117331:0:13057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789265347.117335:0:13057:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:1.0:1789265347.117339:0:13057:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000100:00100000:2.0:1789265347.118875:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789265347.118903:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02df4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:871daf34-1206-40e7-bd71-78303abe4d37:3318:1876180414318336:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789265347.118973:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265347.119024:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414318336 00000100:00100000:2.0:1789265347.119031:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414318336 00000100:00100000:2.0:1789265347.119087:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789265347.119095:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02e32300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3318:x1876180414318336:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789265347.119101:0:5827:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789265347 with bad export cookie 2821306866759703435 00000100:00100000:2.0:1789265347.119145:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02e32300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3318:x1876180414318336:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (171us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789265347.119163:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1789265347.119196:0:3318:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.137@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789265347.119201:0:3318:0:(import.c:65:import_set_state_nolock()) ffff8a10090ce800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1789265347.119204:0:3318:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.137@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000020:01000004:1.0:1789265347.119282:0:13057:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1789265347.119287:0:13057:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00010000:00010000:1.0:1789265347.119300:0:12904:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265347.119306:0:12904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff8a1017262400/0x27274ba5bb9520d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x27274ba5bb9520e0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265347.119314:0:12904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1017262400 already unused, calling callback (ffffffffc1ba2c20) 10000000:00010000:1.0:1789265347.119318:0:12904:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff8a1017262400/0x27274ba5bb9520d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x27274ba5bb9520e0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265347.119332:0:12904:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff8a1017262400/0x27274ba5bb9520d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x27274ba5bb9520e0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265347.119338:0:12904:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff8a1017262400/0x27274ba5bb9520d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x27274ba5bb9520e0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265347.119344:0:12904:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789265347.119346:0:12904:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789265347.119360:0:12904:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000100:00100000:0.0:1789265347.132656:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1016d45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3315:x1876180414318208:12345-0@lo:103:ldlm_bl.0 Request processed in 17413us (17530us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789265347.132671:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1789265347.132720:0:3315:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.137@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789265347.147679:0:3318:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.137@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1789265347.147685:0:3318:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1789265347.147696:0:3318:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a1016d44a80 x1876180414318208/t0(0) o103->MGC192.168.203.137@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789265363 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265347.147712:0:3318:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a0f02df4380 x1876180414318336/t0(0) o103->MGC192.168.203.137@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789265363 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1789265347.147721:0:3318:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1789265347.147723:0:3318:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1789265347.147725:0:3318:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00010000:00010000:1.0:1789265347.147925:0:12904:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff8a1017262400/0x27274ba5bb9520d9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x27274ba5bb9520e0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265347.147936:0:12904:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789265347.147972:0:12904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff8a1017262400/0x27274ba5bb9520d9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x27274ba5bb9520e0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265347.147980:0:12904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff8a1017262400/0x27274ba5bb9520d9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x27274ba5bb9520e0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265347.147998:0:12904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265347.148000:0:12904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265347.148002:0:12904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789265347.148025:0:13057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789265347.148036:0:13057:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789265347.148040:0:13057:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8a10037d0000) has no exports 00000100:00100000:3.0:1789265347.148060:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000020:00080000:1.0:1789265347.148097:0:13057:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8a10037d0000) has no exports 00000100:00100000:3.0:1789265347.148109:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02df6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:871daf34-1206-40e7-bd71-78303abe4d37:0:1876180414318464:0@lo:103:ldlm_bl.0 00000020:01000000:1.0:1789265347.149732:0:13057:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a103fc071e0 - data ffff8a1025ba7af8/ffff8a102ee95400 00000020:01000000:1.0:1789265347.149900:0:13057:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a1009002780 - data ffff8a102b3570d8/ffff8a0f01101800 00000100:00080000:0.0:1789265347.150549:0:3315:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8a10090ce800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:0.0:1789265347.150573:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1016d44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:871daf34-1206-40e7-bd71-78303abe4d37:3315:1876180414318208:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1789265347.150691:0:3318:0:(import.c:65:import_set_state_nolock()) ffff8a10090ce800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789265347.150697:0:3318:0:(import.c:510:import_select_connection()) MGC192.168.203.137@tcp: connect to NID 0@lo last attempt 178 00000100:00080000:2.0:1789265347.150705:0:3318:0:(import.c:624:import_select_connection()) MGC192.168.203.137@tcp: import ffff8a10090ce800 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:2.0:1789265347.150737:0:3318:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a0f02e33800 x1876180414318592/t0(0) o250->MGC192.168.203.137@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789265347.150771:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02df4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:871daf34-1206-40e7-bd71-78303abe4d37:3318:1876180414318336:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789265347.150841:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02e33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:871daf34-1206-40e7-bd71-78303abe4d37:3314:1876180414318592:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:0.0:1789265347.150892:0:3314:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876180414318592 offset 0 length 520: 4 00100000:10000000:1.0:1789265347.164422:0:13057:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1789265347.211923:0:13057:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x27274ba5bb951cbf 00000020:00000080:1.0:1789265347.211944:0:13057:0:(genops.c:885:class_export_put()) final put ffff8a100916b800/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1789265347.211958:0:13057:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a103c151000 from lustre-OST0000, refs=2 00000020:01000004:1.0:1789265347.211961:0:13057:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a103c151000 2 00000020:01000004:1.0:1789265347.211964:0:13057:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8a103c151000 from lustre-OST0000 00000020:00000080:1.0:1789265347.211985:0:13057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789265347.211995:0:13057:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1789265347.211998:0:13057:0:(genops.c:885:class_export_put()) final put ffff8a102e522800/lustre-OST0000_UUID 00000020:00000080:1.0:1789265347.212000:0:13057:0:(genops.c:844:class_export_destroy()) destroying export ffff8a102e522800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1789265347.212010:0:13057:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1789265347.212061:0:13057:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1789265347.212066:0:13057:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1789265347.212069:0:13057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789265347.212091:0:13057:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789265347.212098:0:13057:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8a1037ed7800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789265347.212104:0:13057:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff8a1037ecb370) has exports, disconnecting them 00000020:00080000:1.0:1789265347.212109:0:13057:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8a1037ed7800), last request at 1789265148 00000020:00000080:1.0:1789265347.212114:0:13057:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x27274ba5bb951ce9 00000020:00080000:1.0:1789265347.212123:0:13057:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a1037ed7800): rc 0 00000020:00000080:1.0:1789265347.212127:0:13057:0:(genops.c:885:class_export_put()) final put ffff8a1037ed7800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1789265347.213125:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a100916b800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1789265347.213146:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1037ed7800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1789265347.215784:0:13057:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1789265347.215792:0:13057:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789265347.215797:0:13057:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789265347.215813:0:13057:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789265347.216001:0:13057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789265347.216009:0:13057:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1789265347.216016:0:13057:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a103c151000 1 00000020:00000080:0.0:1789265347.216022:0:13057:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x27274ba5bb951c79 00000020:00000080:0.0:1789265347.216030:0:13057:0:(genops.c:885:class_export_put()) final put ffff8a103cd3b800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1789265347.216036:0:13057:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1789265347.216043:0:13057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789265347.216047:0:13057:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789265347.216050:0:13057:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8a10037d19b8) has no exports 00000020:00000080:2.0:1789265347.216149:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1037ed0000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1789265347.216159:0:37:0:(genops.c:885:class_export_put()) final put ffff8a103d8c5800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1789265347.216162:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a103d8c5800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1789265347.216171:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1789265347.216234:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a103cd3b800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1789265347.249862:0:13057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789265347.249878:0:13057:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1789265347.249884:0:13057:0:(genops.c:885:class_export_put()) final put ffff8a103c153000/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1789265347.249889:0:13057:0:(genops.c:844:class_export_destroy()) destroying export ffff8a103c153000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1789265347.249899:0:13057:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1789265347.250138:0:13057:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8a103c154000 00000020:02000400:0.0:1789265347.250185:0:13057:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00000100:00080000:1.0:1789265347.381339:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 871daf34-1206-40e7-bd71-78303abe4d37->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789265347.381349:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 871daf34-1206-40e7-bd71-78303abe4d37->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789265347.381352:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789265347.381355:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789265347.381359:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a0f029e6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789265347.381366:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 388 00000100:00080000:1.0:1789265347.381372:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789265347.381379:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a0f029e6800 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:1.0:1789265347.381417:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a0f02df4a80 x1876180414318720/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789265347.381621:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02df4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3314:1876180414318720:0@lo:38:kworker.0 00000400:00000100:3.0:1789265347.381672:0:3314:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876180414318720 offset 0 length 520: 4 00010000:00010000:0.0:1789265347.891503:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265348.925335:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265349.938892:0:12904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789265350.198853:0:13206:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1789265350.209639:0:13206:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1789265350.209715:0:13206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a1000031600/0x27274ba5bb951e9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951ea2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.209742:0:13206:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a1000031600/0x27274ba5bb951e9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x27274ba5bb951ea2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.209749:0:13206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a1000031600/0x27274ba5bb951e9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x27274ba5bb951ea2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.209756:0:13206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.137@tcp lock: ffff8a1000031600/0x27274ba5bb951e9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x27274ba5bb951ea2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.209772:0:13206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789265350.209777:0:13206:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:0.0:1789265350.209811:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265350.209826:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff8a1000031600/0x27274ba5bb951e9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x27274ba5bb951ea2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.209834:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1000031600 already unused, calling callback (ffffffffc1ba2c20) 10000000:00010000:0.0:1789265350.209838:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff8a1000031600/0x27274ba5bb951e9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x27274ba5bb951ea2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.209847:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff8a1000031600/0x27274ba5bb951e9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x27274ba5bb951ea2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789265350.209854:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff8a1000031600/0x27274ba5bb951e9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x27274ba5bb951ea2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265350.209860:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789265350.209862:0:5828:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789265350.209873:0:5828:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789265350.209889:0:5828:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a10090ce800 00010000:00010000:0.0:1789265350.209898:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff8a1000031600/0x27274ba5bb951e9b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x27274ba5bb951ea2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.209905:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff8a1000031600/0x27274ba5bb951e9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x27274ba5bb951ea2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.209918:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265350.209920:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265350.209922:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789265350.210165:0:13206:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789265350.210178:0:13206:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a0f02df4a80 x1876180414318720/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789265362 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265350.210195:0:13206:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789265350.210200:0:13206:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789265350.210206:0:13206:0:(import.c:65:import_set_state_nolock()) ffff8a0f029e6800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1789265350.210211:0:13206:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789265350.210214:0:13206:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a0f02df4a80 x1876180414318720/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789265362 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265350.210221:0:13206:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789265350.210224:0:13206:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00000100:00100000:3.0:1789265350.211550:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02df4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3314:1876180414318720:0@lo:38:kworker.0 00010000:00010000:0.0:1789265350.213169:0:13206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a103fad7800/0x27274ba5bb951ea9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb951eb0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.213188:0:13206:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a103fad7800/0x27274ba5bb951ea9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x27274ba5bb951eb0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.213196:0:13206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a103fad7800/0x27274ba5bb951ea9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x27274ba5bb951eb0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.213203:0:13206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.137@tcp lock: ffff8a103fad7800/0x27274ba5bb951ea9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x27274ba5bb951eb0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.213234:0:13206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789265350.213240:0:13206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a103fad6800/0x27274ba5bb9520cb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb9520d2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.213247:0:13206:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a103fad6800/0x27274ba5bb9520cb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27274ba5bb9520d2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.213254:0:13206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a103fad6800/0x27274ba5bb9520cb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x27274ba5bb9520d2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.213260:0:13206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.137@tcp lock: ffff8a103fad6800/0x27274ba5bb9520cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x27274ba5bb9520d2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265350.213273:0:13206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1789265350.213278:0:13206:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1789265350.213535:0:13206:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00010000:00010000:1.0:1789265350.213538:0:12904:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789265350.213546:0:12904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff8a103fad7800/0x27274ba5bb951ea9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x27274ba5bb951eb0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:0.0:1789265350.213549:0:13206:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1789265350.213554:0:13206:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00010000:00010000:1.0:1789265350.213555:0:12904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad7800 already unused, calling callback (ffffffffc1ba2c20) 10000000:00010000:1.0:1789265350.213558:0:12904:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff8a103fad7800/0x27274ba5bb951ea9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x27274ba5bb951eb0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1789265350.213559:0:13206:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789265350.213563:0:13206:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8a100878b370) has no exports 00010000:00010000:1.0:1789265350.213567:0:12904:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff8a103fad7800/0x27274ba5bb951ea9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x27274ba5bb951eb0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265350.213573:0:12904:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff8a103fad7800/0x27274ba5bb951ea9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x27274ba5bb951eb0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265350.213579:0:12904:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789265350.213582:0:12904:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1789265350.213584:0:12904:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00000020:00080000:0.0:1789265350.213586:0:13206:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8a100878b370) has no exports 00010000:00010000:1.0:1789265350.213596:0:12904:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a10090ce800 00010000:00010000:1.0:1789265350.213599:0:12904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff8a103fad7800/0x27274ba5bb951ea9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x27274ba5bb951eb0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265350.213605:0:12904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff8a103fad7800/0x27274ba5bb951ea9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x27274ba5bb951eb0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265350.213618:0:12904:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265350.213621:0:12904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff8a103fad6800/0x27274ba5bb9520cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x27274ba5bb9520d2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265350.213627:0:12904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad6800 already unused, calling callback (ffffffffc1ba2c20) 10000000:00010000:1.0:1789265350.213636:0:12904:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff8a103fad6800/0x27274ba5bb9520cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x27274ba5bb9520d2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265350.213643:0:12904:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff8a103fad6800/0x27274ba5bb9520cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x27274ba5bb9520d2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265350.213649:0:12904:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff8a103fad6800/0x27274ba5bb9520cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x27274ba5bb9520d2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265350.213655:0:12904:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789265350.213657:0:12904:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789265350.213658:0:12904:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789265350.213664:0:12904:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a10090ce800 00010000:00010000:1.0:1789265350.213666:0:12904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff8a103fad6800/0x27274ba5bb9520cb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x27274ba5bb9520d2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265350.213673:0:12904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff8a103fad6800/0x27274ba5bb9520cb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x27274ba5bb9520d2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265350.213684:0:12904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265350.213686:0:12904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265350.213688:0:12904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265350.214989:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1789265350.218892:0:13206:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a103fc07f00 - data ffff8a1025ba7360/ffff8a102ee97c00 00000020:01000000:0.0:1789265350.219048:0:13206:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a10349ff8a0 - data ffff8a0f0161d438/ffff8a102ec4c800 00100000:10000000:0.0:1789265350.237000:0:13206:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1789265350.268102:0:13206:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x27274ba5bb951d8a 00000020:00000080:3.0:1789265350.268113:0:13206:0:(genops.c:885:class_export_put()) final put ffff8a103c157800/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1789265350.268129:0:13206:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a103bd8f000 from lustre-OST0001, refs=2 00000020:01000004:3.0:1789265350.268133:0:13206:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a103bd8f000 2 00000020:01000004:3.0:1789265350.268136:0:13206:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8a103bd8f000 from lustre-OST0001 00000020:00000080:3.0:1789265350.268160:0:13206:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789265350.268169:0:13206:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1789265350.268172:0:13206:0:(genops.c:885:class_export_put()) final put ffff8a1016d21000/lustre-OST0001_UUID 00000020:00000080:3.0:1789265350.268175:0:13206:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1016d21000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1789265350.268181:0:13206:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1789265350.268308:0:13206:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 871daf34-1206-40e7-bd71-78303abe4d37->MGS 00010000:00010000:3.0:1789265350.268333:0:13206:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff8a10421ebe00/0x27274ba5bb951c9c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x27274ba5bb951ca3 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789265350.268346:0:13206:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff8a10421ebe00/0x27274ba5bb951c9c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x27274ba5bb951ca3 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265350.268352:0:13206:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1789265350.268355:0:13206:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1789265350.268357:0:13206:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1789265350.268371:0:13206:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a10090ce800 00010000:00010000:3.0:1789265350.268375:0:13206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff8a10421ebe00/0x27274ba5bb951c9c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x27274ba5bb951ca3 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265350.268398:0:13206:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff8a103fad7c00/0x27274ba5bb951f19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x27274ba5bb951f20 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789265350.268404:0:13206:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff8a103fad7c00/0x27274ba5bb951f19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x27274ba5bb951f20 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265350.268409:0:13206:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789265350.268411:0:13206:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1789265350.268413:0:13206:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1789265350.268422:0:13206:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a10090ce800 00010000:00010000:3.0:1789265350.268425:0:13206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff8a103fad7c00/0x27274ba5bb951f19 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x27274ba5bb951f20 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789265350.268439:0:13206:0:(import.c:65:import_set_state_nolock()) ffff8a10090ce800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1789265350.268443:0:13206:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1789265350.268445:0:13206:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1789265350.268446:0:13206:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1789265350.268450:0:13206:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1789265350.268462:0:13206:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a0f02e33800 x1876180414318592/t0(0) o250->MGC192.168.203.137@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789265357 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1789265350.268486:0:13206:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1789265350.268489:0:13206:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000020:00000080:0.0:1789265350.268634:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a103c157800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:2.0:1789265350.269256:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02e33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:871daf34-1206-40e7-bd71-78303abe4d37:3314:1876180414318592:0@lo:250:ptlrpcd_00_03.0 10000000:01000000:3.0:1789265350.269344:0:13206:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1789265350.269353:0:13206:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x27274ba5bb951b7d 00000020:00000080:3.0:1789265350.269359:0:13206:0:(genops.c:885:class_export_put()) final put ffff8a10090c8800/871daf34-1206-40e7-bd71-78303abe4d37 00000020:01000000:3.0:1789265350.269376:0:13206:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.137@tcp (flags='') 00000020:00000080:3.0:1789265350.269381:0:13206:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789265350.269387:0:13206:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.137@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789265350.269390:0:13206:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff8a10087899b8) has no exports 00000020:00000080:0.0:1789265350.269443:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a10090c8800/871daf34-1206-40e7-bd71-78303abe4d37 for MGC192.168.203.137@tcp 10000000:01000000:2.0:1789265350.269491:0:5837:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1789265350.269583:0:13206:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.137@tcp: client import never connected 00000100:00080000:3.0:1789265350.269587:0:13206:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1789265350.269589:0:13206:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1789265350.269592:0:13206:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1789265350.269594:0:13206:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1789265350.269635:0:13206:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789265350.269640:0:13206:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.137@tcp (uuid 871daf34-1206-40e7-bd71-78303abe4d37) 00000020:01000000:3.0:1789265350.269645:0:13206:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1789265350.269648:0:13206:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789265350.269652:0:13206:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789265350.269656:0:13206:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8a103fbdc800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789265350.269661:0:13206:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff8a1037ec99b8) has exports, disconnecting them 00000020:00080000:3.0:1789265350.269665:0:13206:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8a103fbdc800), last request at 1789265165 00000020:00000080:3.0:1789265350.269669:0:13206:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x27274ba5bb951db4 00000020:00080000:3.0:1789265350.269679:0:13206:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a103fbdc800): rc 0 00000020:00000080:3.0:1789265350.269683:0:13206:0:(genops.c:885:class_export_put()) final put ffff8a103fbdc800/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1789265350.270014:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a10090ce800 for MGC192.168.203.137@tcp 00000020:00000080:0.0:1789265350.270021:0:36:0:(genops.c:885:class_export_put()) final put ffff8a10090ca000/871daf34-1206-40e7-bd71-78303abe4d37 00000020:00000080:0.0:1789265350.270032:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a10090ca000/871daf34-1206-40e7-bd71-78303abe4d37 for MGC192.168.203.137@tcp 00000020:01000000:0.0:1789265350.270037:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.137@tcp (871daf34-1206-40e7-bd71-78303abe4d37) 00000020:00000080:0.0:1789265350.270300:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a103fbdc800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1789265350.272169:0:13206:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1789265350.272177:0:13206:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789265350.272181:0:13206:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789265350.272188:0:13206:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789265350.272283:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:0.0:1789265350.272385:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a0f029e6800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:0.0:1789265350.272477:0:12904:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1789265350.272667:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1789265350.272826:0:5823:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8a1004855800:5823] 0 exiting: rc = 1 00000100:00100000:0.0:1789265350.272918:0:5824:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8a1004855200:5824] 1 exiting: rc = 0 00000100:00100000:2.0:1789265350.273008:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.273259:0:5827:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8a10119e4e00:5827] 2 exiting: rc = 0 00000100:00100000:0.0:1789265350.273358:0:5825:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8a10119e4200:5825] 0 exiting: rc = 1 00000100:00100000:0.0:1789265350.273407:0:5826:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8a10119e5400:5826] 1 exiting: rc = 0 00000100:00100000:2.0:1789265350.274149:0:8490:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8a1018797400:8490] 3 exiting: rc = 0 00000100:00100000:0.0:1789265350.274259:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265350.274267:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265350.274273:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265350.274280:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265350.274286:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265350.274291:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265350.274296:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265350.274302:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265350.274308:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265350.274313:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265350.274319:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265350.274324:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265350.274329:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265350.274336:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265350.274343:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265350.274348:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265350.274355:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265350.274360:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265350.274366:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265350.274370:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265350.274375:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265350.274380:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265350.274397:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265350.274402:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265350.274406:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265350.274410:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265350.274415:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265350.274419:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265350.274423:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265350.274428:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265350.274433:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265350.274437:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265350.274441:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265350.274446:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265350.274451:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265350.274457:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265350.274461:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265350.274466:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265350.274471:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265350.274476:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265350.274480:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265350.274485:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265350.274489:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265350.274494:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265350.274499:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265350.274504:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265350.274508:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265350.274513:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265350.274517:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265350.274522:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265350.274527:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265350.274532:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265350.274537:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265350.274543:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265350.274548:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265350.274554:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265350.274559:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265350.274571:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265350.274590:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265350.274595:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265350.274601:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265350.274606:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265350.274612:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265350.274617:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1789265350.281625:0:13206:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789265350.281639:0:13206:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1789265350.281645:0:13206:0:(genops.c:885:class_export_put()) final put ffff8a100901b800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1789265350.281649:0:13206:0:(genops.c:844:class_export_destroy()) destroying export ffff8a100901b800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1789265350.281655:0:13206:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:0.0:1789265350.281692:0:13206:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a103bd8f000 1 00000020:00000080:0.0:1789265350.281697:0:13206:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x27274ba5bb951d59 00000020:00000080:0.0:1789265350.281703:0:13206:0:(genops.c:885:class_export_put()) final put ffff8a103bd89800/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1789265350.281714:0:13206:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1789265350.281724:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a103bd89800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1789265350.281732:0:13206:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789265350.281736:0:13206:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789265350.281740:0:13206:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8a1008f43370) has no exports 00000020:00000080:2.0:1789265350.299243:0:13206:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789265350.299260:0:13206:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1789265350.299266:0:13206:0:(genops.c:885:class_export_put()) final put ffff8a103bd8c800/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1789265350.299271:0:13206:0:(genops.c:844:class_export_destroy()) destroying export ffff8a103bd8c800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1789265350.299283:0:13206:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1789265350.299491:0:13206:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8a103bd8e800 00000020:01000000:2.0:1789265350.299517:0:13206:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1789265350.299521:0:13206:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789265350.299526:0:13206:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789265350.299530:0:13206:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff8a1008f40000) has no exports 00000020:00000080:2.0:1789265350.299558:0:13206:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789265350.299564:0:13206:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1789265350.299568:0:13206:0:(genops.c:885:class_export_put()) final put ffff8a103cd38000/OSS_uuid 00000020:00000080:2.0:1789265350.299570:0:13206:0:(genops.c:844:class_export_destroy()) destroying export ffff8a103cd38000/OSS_uuid for OSS 00000020:01000000:2.0:1789265350.300436:0:13206:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1789265350.301688:0:8856:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8a102ec37c00:8856] 3 exiting: rc = 0 00000100:00100000:0.0:1789265350.302218:0:6682:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8a1041a65000:6682] 0 exiting: rc = 1 00000100:00100000:0.0:1789265350.302287:0:12007:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff8a103fa40600:12007] 4 exiting: rc = 0 00000100:00100000:0.0:1789265350.302361:0:6685:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8a102e51e200:6685] 2 exiting: rc = 0 00000100:00080000:1.0:1789265350.303144:0:5836:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1789265350.303348:0:6684:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8a100910a200:6684] 1 exiting: rc = 0 00000100:00100000:2.0:1789265350.303506:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.303515:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.303523:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.303530:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.303536:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.303542:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.303548:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.303567:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.303676:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.303685:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.303691:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.303695:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.303700:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.303705:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.303710:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.303715:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.303720:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.303725:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.303730:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.303734:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.303739:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.303743:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.303748:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.303753:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.303758:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.303763:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.304157:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.304163:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.304168:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.304174:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.304179:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.304184:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.304188:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.304193:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.304198:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.304202:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.304207:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.304220:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.304227:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.304231:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.304236:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.304240:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.304256:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.304261:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.304267:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.304272:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.304277:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.304283:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.304288:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.304293:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.304298:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.304303:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.304309:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.304315:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.304320:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.304325:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.304330:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.304336:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.304342:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.304350:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.304356:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.304361:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.304366:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.304372:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265350.305686:0:6687:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8a102e51fc00:6687] 1 exiting: rc = 0 00000100:00100000:1.0:1789265350.306071:0:6686:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8a102e532a00:6686] 0 exiting: rc = 1 00000100:00100000:2.0:1789265350.307999:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.308011:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.308016:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.308022:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.308027:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.308032:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.308037:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.308043:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.308048:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.308053:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.308058:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.308062:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.308068:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.308146:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.308151:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.308156:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.308162:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.308167:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.308173:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.308178:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.308183:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.308188:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.308193:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.308198:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.308203:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.308208:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.308273:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.308280:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.308285:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.308290:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.308295:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.308300:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.308305:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.308310:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.308315:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.308320:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.308325:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.308331:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.308336:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.308342:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.308348:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.308354:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.308359:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.308364:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.308369:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.308375:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.308380:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.308384:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.308395:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.308400:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.308404:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.308408:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.308414:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.308420:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.308424:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.308429:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.308434:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.308438:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.308443:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.308448:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.308452:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.308456:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.308461:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.308466:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265350.311789:0:6690:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8a102e51e600:6690] 2 exiting: rc = 0 00000100:00100000:0.0:1789265350.312062:0:6689:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8a102ef97800:6689] 1 exiting: rc = 0 00000100:00100000:3.0:1789265350.312337:0:6688:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8a102ef97a00:6688] 0 exiting: rc = 1 00000100:00100000:2.0:1789265350.312559:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.312566:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.312572:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.312587:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.312593:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.312598:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.312603:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.312609:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.312614:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.312619:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.312624:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.312629:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.312634:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.312639:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.312644:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.312649:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.312654:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.312659:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.312664:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.312688:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.312694:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.312699:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.312704:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.312709:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.312715:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.312720:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.312725:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.312731:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.312735:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.312740:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.312746:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.312751:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.312756:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.312762:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.312774:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.312787:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.312793:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.312798:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.312804:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.312810:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.312815:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.312821:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.312827:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.312844:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.312850:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.312856:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.312861:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.312867:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.312872:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.312878:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.312883:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.313034:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.313049:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.313056:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.313066:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.313093:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.313100:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.313105:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.313111:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.313120:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.313126:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.313131:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.313137:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.313143:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265350.325051:0:6691:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8a103d83d800:6691] 0 exiting: rc = 1 00000100:00100000:1.0:1789265350.328599:0:6692:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8a103d83c000:6692] 1 exiting: rc = 0 00000100:00100000:2.0:1789265350.328771:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.328787:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.328792:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.328798:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.328802:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.328811:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.328816:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.328821:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.328825:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.328830:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.328836:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.328841:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.328846:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.328851:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.328857:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.328862:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.328868:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.328873:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.328878:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.328883:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.328888:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.329281:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.329289:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.329295:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.329299:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.329317:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.329322:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.329327:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.329333:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.329565:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.329574:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.329579:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.329709:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.329749:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.329755:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.329975:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.329986:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.329991:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.329996:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.330001:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.330006:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.330011:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.330018:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.330022:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.330027:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.330033:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.330038:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.330043:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.330049:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.330054:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.330058:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.330063:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.330068:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.330097:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.330103:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.330108:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.330113:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.330118:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.330123:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.330128:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.330143:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.330148:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.330153:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.330158:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.331169:0:6694:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8a1008740c00:6694] 1 exiting: rc = 0 00000100:00100000:0.0:1789265350.331568:0:6693:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8a1016da7c00:6693] 0 exiting: rc = 1 00000100:00100000:2.0:1789265350.331768:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.331789:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.331797:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.331803:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.331808:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.331814:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.331819:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.331825:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.331831:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.331836:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.331853:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.331860:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.331866:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.331872:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.331877:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.331883:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.331949:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.331958:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.331964:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.331970:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.331975:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.331981:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.331999:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.332006:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.332012:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.332018:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.332024:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.332029:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.332034:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.332040:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.332054:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.332060:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.332065:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.332071:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.332125:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.332131:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.332137:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.332143:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.332150:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.332156:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.332164:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.332170:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.332176:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.332183:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.332190:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.332198:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.332275:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.332283:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.332289:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.332296:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.332302:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.332309:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.332315:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.332321:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.332327:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.332333:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.332339:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.332345:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.332366:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.332372:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.332378:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.332383:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.332388:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265350.332401:0:13206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1789265350.343419:0:13206:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1789265368.815666:0:13826:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg337-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1789265378.521890:0:14286:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789265378.521896:0:14286:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1789265378.522003:0:14286:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8a102eccb800 00000020:01000004:1.0:1789265378.523314:0:14286:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1789265378.523328:0:14286:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1789265378.523345:0:14286:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8a10037d0000) 00000020:00000080:1.0:1789265378.523377:0:14286:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789265378.601574:0:14286:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1789265378.609599:0:14286:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1789265378.611379:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:2.0:1789265378.611487:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:2.0:1789265378.612916:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:2.0:1789265378.613114:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:2.0:1789265378.613214:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:2.0:1789265378.613446:0:14286:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1789265378.613524:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:2.0:1789265378.615366:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 453: rc = 0 00100000:10000000:2.0:1789265378.621395:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 640: rc = 0 00100000:10000000:2.0:1789265378.621493:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 640: rc = 0 00100000:10000000:2.0:1789265378.624402:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 358: rc = 0 00100000:10000000:2.0:1789265378.627487:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 358: rc = 0 00100000:10000000:2.0:1789265378.629929:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 358: rc = 0 00100000:10000000:3.0:1789265378.636987:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 358: rc = 0 00100000:10000000:3.0:1789265378.637355:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 358: rc = 0 00100000:10000000:3.0:1789265378.638136:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 358: rc = 0 00100000:10000000:3.0:1789265378.638415:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 358: rc = 0 00100000:10000000:3.0:1789265378.638671:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 358: rc = 0 00100000:10000000:3.0:1789265378.638910:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 358: rc = 0 00100000:10000000:3.0:1789265378.639182:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 358: rc = 0 00100000:10000000:3.0:1789265378.639422:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 358: rc = 0 00100000:10000000:3.0:1789265378.639681:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 358: rc = 0 00100000:10000000:3.0:1789265378.640132:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 655: rc = 0 00100000:10000000:3.0:1789265378.640360:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 655: rc = 0 00100000:10000000:3.0:1789265378.649137:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 655: rc = 0 00100000:10000000:3.0:1789265378.649515:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 655: rc = 0 00100000:10000000:3.0:1789265378.649923:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 655: rc = 0 00100000:10000000:3.0:1789265378.650372:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 655: rc = 0 00100000:10000000:3.0:1789265378.650611:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 655: rc = 0 00100000:10000000:3.0:1789265378.650849:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 655: rc = 0 00100000:10000000:3.0:1789265378.651114:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 655: rc = 0 00100000:10000000:3.0:1789265378.651354:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 655: rc = 0 00100000:10000000:3.0:1789265378.651582:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 655: rc = 0 00100000:10000000:3.0:1789265378.651850:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 655: rc = 0 00100000:10000000:3.0:1789265378.656314:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 655: rc = 0 00100000:10000000:3.0:1789265378.656841:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 655: rc = 0 00100000:10000000:3.0:1789265378.657120:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 655: rc = 0 00100000:10000000:3.0:1789265378.657378:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 655: rc = 0 00100000:10000000:3.0:1789265378.659949:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 655: rc = 0 00100000:10000000:0.0:1789265378.663169:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 655: rc = 0 00100000:10000000:0.0:1789265378.663466:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 655: rc = 0 00100000:10000000:0.0:1789265378.663919:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 655: rc = 0 00100000:10000000:0.0:1789265378.664216:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 655: rc = 0 00100000:10000000:0.0:1789265378.664460:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 655: rc = 0 00100000:10000000:0.0:1789265378.670000:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 655: rc = 0 00100000:10000000:0.0:1789265378.670271:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 655: rc = 0 00100000:10000000:0.0:1789265378.670506:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 655: rc = 0 00100000:10000000:0.0:1789265378.675757:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 655: rc = 0 00100000:10000000:0.0:1789265378.676132:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 655: rc = 0 00100000:10000000:0.0:1789265378.676379:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 655: rc = 0 00100000:10000000:0.0:1789265378.676653:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 655: rc = 0 00100000:10000000:0.0:1789265378.676906:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 655: rc = 0 00100000:10000000:0.0:1789265378.677186:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 655: rc = 0 00100000:10000000:0.0:1789265378.677436:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 655: rc = 0 00100000:10000000:0.0:1789265378.677818:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 644: rc = 0 00100000:10000000:0.0:1789265378.678329:0:14286:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:0.0:1789265378.678482:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 641: rc = 0 00100000:10000000:0.0:1789265378.687125:0:14286:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:0.0:1789265378.687227:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 641: rc = 0 00100000:10000000:0.0:1789265378.687457:0:14286:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:0.0:1789265378.687527:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 641: rc = 0 00100000:10000000:0.0:1789265378.688056:0:14286:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:0.0:1789265378.688158:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 49: rc = 0 00100000:10000000:0.0:1789265378.688353:0:14286:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:0.0:1789265378.688427:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 49: rc = 0 00100000:10000000:0.0:1789265378.688979:0:14286:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:0.0:1789265378.689055:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 49: rc = 0 00000020:00000080:0.0:1789265378.689849:0:14286:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1789265378.689864:0:14286:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789265378.689874:0:14286:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x27274ba5bb952e7e 00000020:01000004:0.0:1789265378.689883:0:14286:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:0.0:1789265378.689888:0:14286:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1789265378.689892:0:14286:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a102eccb800 from MGS 00000020:01000004:0.0:1789265378.689896:0:14286:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1789265378.689906:0:14286:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8a1037ec99b8) 00000020:00000080:0.0:1789265378.689915:0:14286:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1789265378.689968:0:14286:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a102eccb800 from MGS, refs=2 00080000:01000000:0.0:1789265378.689971:0:14286:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789265378.689977:0:14286:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x27274ba5bb952e8c 00000100:00100000:0.0:1789265378.690065:0:14286:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1789265378.690229:0:14286:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1789265378.690234:0:14286:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1789265378.693914:0:14286:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1789265378.693928:0:14286:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1789265378.695722:0:14286:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789265378.695919:0:14286:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1789265378.695925:0:14286:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1789265378.697062:0:14286:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1789265378.697105:0:14286:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1789265378.698177:0:14286:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1789265378.698188:0:14286:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1789265378.705302:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265378.705308:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265378.705310:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265378.705612:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265378.705614:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265378.705616:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265378.709617:0:14286:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1789265378.721772:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1789265378.730384:0:14286:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1789265378.730404:0:14286:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789265378.730407:0:14286:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1789265378.745795:0:14295:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1789265378.748238:0:14286:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1789265378.748381:0:14286:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789265378.748864:0:14286:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1789265378.749228:0:14286:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789265378.749404:0:14286:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1789265378.749410:0:14286:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1789265378.751305:0:14286:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1789265378.751317:0:14286:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1789265378.755407:0:14286:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1789265378.755419:0:14286:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1789265378.759995:0:14286:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1789265378.760017:0:14286:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.137@tcp' 00000020:01000004:3.0:1789265378.760019:0:14286:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1789265378.760047:0:14286:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.137@tcp (typ=mgc) 00000020:00000080:3.0:1789265378.760059:0:14286:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.137@tcp (ffff8a100878b370) 00000020:00000080:3.0:1789265378.760101:0:14286:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1789265378.760179:0:14286:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a103bd88800@MGC192.168.203.137@tcp: add connection 192.168.203.137@tcp at head 00010000:00010000:3.0:1789265378.760328:0:14286:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.137@tcp-0 is initialized 00000040:01000000:3.0:1789265378.760335:0:14286:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.137@tcp ctxt 1 is initialized 00000100:00080000:0.0:1789265378.760628:0:14300:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1789265378.765158:0:14301:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1789265378.765299:0:14286:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.137@tcp (uuid 5d1176c1-422e-4242-ae69-e8c37ea2d5cc) 00000020:00000080:0.0:1789265378.765323:0:14286:0:(genops.c:1385:class_connect()) connect: client 5d1176c1-422e-4242-ae69-e8c37ea2d5cc, cookie 0x27274ba5bb952e9a 00000100:00080000:0.0:1789265378.765337:0:14286:0:(import.c:510:import_select_connection()) MGC192.168.203.137@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789265378.765343:0:14286:0:(import.c:624:import_select_connection()) MGC192.168.203.137@tcp: import ffff8a103bd88800 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:0.0:1789265378.765379:0:14286:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1016d44000 x1876180414318848/t0(0) o250->MGC192.168.203.137@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789265378.765417:0:14286:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 5d1176c1-422e-4242-ae69-e8c37ea2d5cc->MGS 00000020:01000004:0.0:1789265378.765442:0:14286:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1789265378.765448:0:14286:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1789265378.765462:0:14286:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8a1037ecb370) 00000020:00000080:0.0:1789265378.765473:0:14286:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1789265378.766149:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1016d44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:3314:1876180414318848:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1789265378.766217:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265378.766288:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414318848 00000100:00100000:3.0:1789265378.766295:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414318848 00000100:00100000:3.0:1789265378.766329:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789265378.766337:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103d8b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3314:x1876180414318848:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1789265378.766361:0:14297:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 5d1176c1-422e-4242-ae69-e8c37ea2d5cc@0@lo t0 exp 0000000000000000 cur 424 last 0 00000020:00000080:3.0:1789265378.766388:0:14297:0:(genops.c:1385:class_connect()) connect: client 5d1176c1-422e-4242-ae69-e8c37ea2d5cc, cookie 0x27274ba5bb952ea8 00000100:00080000:3.0:1789265378.766509:0:14297:0:(import.c:65:import_set_state_nolock()) ffff8a103bd8e800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789265378.766562:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103d8b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+5:3314:x1876180414318848:12345-0@lo:250:mount.lustre.0 Request processed in 223us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265378.766569:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789265378.766613:0:3314:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.137@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1789265378.766621:0:3314:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.137@tcp: connect to target with instance 0 00000100:00080000:3.0:1789265378.766629:0:3314:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.137@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1789265378.766633:0:3314:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1789265378.766637:0:3314:0:(import.c:65:import_set_state_nolock()) ffff8a103bd88800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1789265378.766639:0:3314:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1789265378.766647:0:3314:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1789265378.766660:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1016d44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:3314:1876180414318848:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1789265378.783964:0:14286:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789265378.784216:0:14286:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1789265378.784222:0:14286:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1789265378.788829:0:14286:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1789265378.788842:0:14286:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1789265378.789163:0:14286:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1789265378.789169:0:14286:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1789265378.789806:0:14286:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789265378.789986:0:14286:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1789265378.789991:0:14286:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1789265378.790659:0:14286:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1789265378.790667:0:14286:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1789265378.830890:0:14286:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789265378.831129:0:14286:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1789265378.831136:0:14286:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1789265378.832306:0:14286:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1789265378.832317:0:14286:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1789265378.832823:0:14286:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789265378.832996:0:14286:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789265378.833001:0:14286:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1789265378.833713:0:14286:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789265378.833721:0:14286:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1789265378.834370:0:14286:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789265378.834531:0:14286:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789265378.834536:0:14286:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1789265378.834970:0:14286:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789265378.834975:0:14286:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1789265378.835804:0:14286:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789265378.835959:0:14286:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789265378.835964:0:14286:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1789265378.836557:0:14286:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789265378.836564:0:14286:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1789265378.874756:0:14286:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789265378.874971:0:14286:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789265378.874978:0:14286:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1789265378.879995:0:14286:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789265378.880009:0:14286:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1789265378.885377:0:14286:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789265378.885390:0:14286:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1789265378.886262:0:14286:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1789265378.886287:0:14286:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1789265378.886293:0:14286:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.137@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1789265378.886426:0:14286:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.137@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789265378.886457:0:14286:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.137@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1789265378.886461:0:14286:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789265378.886463:0:14286:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789265378.886464:0:14286:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789265378.886465:0:14286:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789265378.886466:0:14286:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789265378.886468:0:14286:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789265378.886469:0:14286:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789265378.886470:0:14286:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789265378.886472:0:14286:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789265378.886473:0:14286:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789265378.886475:0:14286:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1789265378.886477:0:14286:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789265378.886478:0:14286:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789265378.886479:0:14286:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789265378.886480:0:14286:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789265378.886481:0:14286:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789265378.886482:0:14286:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789265378.886483:0:14286:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789265378.886484:0:14286:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789265378.886489:0:14286:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789265378.886490:0:14286:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789265378.886521:0:14286:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789265378.886538:0:14286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14286:1876180414318976:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789265378.886608:0:14286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265378.886657:0:14286:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10054be900 going to sleep for 11 seconds 00000100:00100000:1.0:1789265378.886733:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414318976 00000100:00100000:1.0:1789265378.886740:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414318976 00000100:00100000:1.0:1789265378.886782:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789265378.886791:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103d8b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+5:14286:x1876180414318976:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789265378.886834:0:14299:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789265378.886836:0:14299:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789265378.886839:0:14299:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1789265378.887425:0:14320:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1789265378.887779:0:14299:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1789265378.888778:0:14321:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1789265378.888785:0:14321:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1789265378.888788:0:14321:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1789265378.888816:0:14321:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1789265378.889161:0:14299:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789265378.889171:0:14299:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1789265378.898725:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103d8b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+5:14286:x1876180414318976:12345-0@lo:253:mount.lustre.0 Request processed in 11926us (12106us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265378.898739:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789265378.898845:0:14286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14286:1876180414318976:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789265378.898861:0:14286:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789265378.898865:0:14286:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789265378.898867:0:14286:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789265378.898868:0:14286:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789265378.898869:0:14286:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789265378.898871:0:14286:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789265378.898872:0:14286:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789265378.898874:0:14286:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789265378.898875:0:14286:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789265378.898877:0:14286:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789265378.898878:0:14286:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789265378.898898:0:14286:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a102eccb800 from lustre-MDT0000 10000000:01000000:0.0:1789265378.898923:0:14286:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1789265378.898927:0:14286:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789265378.898931:0:14286:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8a100878b370 10000000:01000000:0.0:1789265378.898937:0:14286:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789265378.898944:0:14286:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8a100878b370 from 1 10000000:01000000:0.0:1789265378.898947:0:14286:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789265378.898983:0:14286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a103fa35c00/0x27274ba5bb952eaf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265378.899011:0:14286:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff8a103fa35c00/0x27274ba5bb952eaf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265378.899034:0:14286:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff8a103fa35c00/0x27274ba5bb952eaf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265378.899053:0:14286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1016d45180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14286:1876180414319104:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789265378.899122:0:14286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265378.899153:0:14286:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1004df9300 going to sleep for 11 seconds 00000100:00100000:3.0:1789265378.899231:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414319104 00000100:00100000:3.0:1789265378.899237:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414319104 00000100:00100000:3.0:1789265378.899280:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789265378.899289:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103d8b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+5:14286:x1876180414319104:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789265378.899301:0:14297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265378.899317:0:14297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a103fae9600/0x27274ba5bb952eb6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27274ba5bb952eaf expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265378.899338:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a103fae9600/0x27274ba5bb952eb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27274ba5bb952eaf expref: 6 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265378.899347:0:14297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a103fae9600/0x27274ba5bb952eb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb952eaf expref: 6 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265378.899355:0:14297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fae9600, rc 0) 00000100:00100000:3.0:1789265378.899384:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103d8b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+6:14286:x1876180414319104:12345-0@lo:101:mount.lustre.0 Request processed in 97us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265378.899396:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789265378.899563:0:14286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1016d45180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14286:1876180414319104:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789265378.899575:0:14286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff8a103fa35c00/0x27274ba5bb952eaf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb952eb6 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265378.899594:0:14286:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff8a103fa35c00/0x27274ba5bb952eaf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27274ba5bb952eb6 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265378.899644:0:14286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1016d45180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14286:1876180414319232:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789265378.899668:0:14286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265378.899694:0:14286:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1004df9300 going to sleep for 11 seconds 00000100:00100000:3.0:1789265378.899736:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414319232 00000100:00100000:3.0:1789265378.899741:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414319232 00000100:00100000:3.0:1789265378.899770:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789265378.899777:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103d8b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+6:14286:x1876180414319232:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789265378.900008:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103d8b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+6:14286:x1876180414319232:12345-0@lo:501:mount.lustre.0 Request processed in 231us (338us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789265378.900015:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789265378.900154:0:14286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1016d45180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14286:1876180414319232:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789265378.900176:0:14286:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789265378.900197:0:14286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a103fa35c00/0x27274ba5bb952eaf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb952eb6 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265378.900206:0:14286:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff8a103fa35c00/0x27274ba5bb952eaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb952eb6 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265378.900226:0:14286:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8a102eccb800 10000000:01000000:0.0:1789265378.900230:0:14286:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789265378.900234:0:14286:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8a102eccb800 10000000:01000000:0.0:1789265378.900237:0:14286:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1789265378.900240:0:14286:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8a102eccb800 from 1 10000000:01000000:0.0:1789265378.900243:0:14286:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1789265378.900262:0:14286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a103fa34600/0x27274ba5bb952ebd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265378.900269:0:14286:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff8a103fa34600/0x27274ba5bb952ebd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265378.900277:0:14286:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff8a103fa34600/0x27274ba5bb952ebd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265378.900290:0:14286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1016d45180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14286:1876180414319360:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789265378.900314:0:14286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265378.900333:0:14286:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1004df9300 going to sleep for 11 seconds 00000100:00100000:1.0:1789265378.900391:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414319360 00000100:00100000:1.0:1789265378.900401:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414319360 00000100:00100000:1.0:1789265378.900612:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789265378.900621:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103d8b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+6:14286:x1876180414319360:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789265378.900630:0:14298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265378.900642:0:14298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a101b597600/0x27274ba5bb952ec4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27274ba5bb952ebd expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265378.900657:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a101b597600/0x27274ba5bb952ec4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27274ba5bb952ebd expref: 7 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265378.900666:0:14298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a101b597600/0x27274ba5bb952ec4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb952ebd expref: 7 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265378.900673:0:14298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a101b597600, rc 0) 00000100:00100000:1.0:1789265378.900709:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103d8b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+7:14286:x1876180414319360:12345-0@lo:101:mount.lustre.0 Request processed in 90us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265378.900714:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789265378.900770:0:14286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1016d45180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14286:1876180414319360:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789265378.900780:0:14286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff8a103fa34600/0x27274ba5bb952ebd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb952ec4 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265378.900788:0:14286:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff8a103fa34600/0x27274ba5bb952ebd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27274ba5bb952ec4 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265378.900800:0:14286:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1789265378.900816:0:14286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a103fa34600/0x27274ba5bb952ebd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb952ec4 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265378.900829:0:14286:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff8a103fa34600/0x27274ba5bb952ebd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb952ec4 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265378.900835:0:14286:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789265378.900838:0:14286:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789265378.900843:0:14286:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8a102eccb800 10000000:01000000:0.0:1789265378.900845:0:14286:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1789265378.900848:0:14286:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1789265378.900850:0:14286:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789265378.900864:0:14286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a103fa35600/0x27274ba5bb952ecb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265378.900870:0:14286:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff8a103fa35600/0x27274ba5bb952ecb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265378.900877:0:14286:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff8a103fa35600/0x27274ba5bb952ecb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265378.900888:0:14286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1016d45180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14286:1876180414319488:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789265378.900912:0:14286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265378.901026:0:14286:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1004df9300 going to sleep for 11 seconds 00000100:00100000:3.0:1789265378.901132:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414319488 00000100:00100000:3.0:1789265378.901137:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414319488 00000100:00100000:3.0:1789265378.901161:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789265378.901167:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103d8b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+7:14286:x1876180414319488:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789265378.901174:0:14297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265378.901181:0:14297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a103fae8000/0x27274ba5bb952ed2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x27274ba5bb952ecb expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265378.901196:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a103fae8000/0x27274ba5bb952ed2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27274ba5bb952ecb expref: 8 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265378.901205:0:14297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a103fae8000/0x27274ba5bb952ed2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb952ecb expref: 8 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265378.901211:0:14297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fae8000, rc 0) 00000100:00100000:3.0:1789265378.901238:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103d8b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+8:14286:x1876180414319488:12345-0@lo:101:mount.lustre.0 Request processed in 71us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265378.901244:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789265378.901369:0:14286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1016d45180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14286:1876180414319488:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789265378.901379:0:14286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff8a103fa35600/0x27274ba5bb952ecb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb952ed2 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265378.901387:0:14286:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff8a103fa35600/0x27274ba5bb952ecb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x27274ba5bb952ed2 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265378.901439:0:14286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1016d45180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14286:1876180414319616:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789265378.901464:0:14286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265378.901492:0:14286:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1004df9300 going to sleep for 11 seconds 00000100:00100000:3.0:1789265378.901536:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414319616 00000100:00100000:3.0:1789265378.901545:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414319616 00000100:00100000:3.0:1789265378.901562:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789265378.901568:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103b820850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+8:14286:x1876180414319616:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789265378.901960:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103b820850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+9:14286:x1876180414319616:12345-0@lo:501:mount.lustre.0 Request processed in 390us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265378.901966:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789265378.902041:0:14286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1016d45180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14286:1876180414319616:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789265378.902069:0:14286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1016d45180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14286:1876180414319744:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789265378.902134:0:14286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265378.902150:0:14286:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1004df9300 going to sleep for 11 seconds 00000100:00100000:3.0:1789265378.902269:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414319744 00000100:00100000:3.0:1789265378.902274:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414319744 00000100:00100000:3.0:1789265378.902294:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789265378.902300:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103b821050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+9:14286:x1876180414319744:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789265378.902575:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103b821050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+9:14286:x1876180414319744:12345-0@lo:503:mount.lustre.0 Request processed in 274us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265378.902582:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789265378.902864:0:14286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1016d45180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14286:1876180414319744:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789265378.903320:0:14322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1016d45180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14322:1876180414319872:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789265378.903366:0:14322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265378.903400:0:14322:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10054be300 going to sleep for 11 seconds 00000100:00100000:3.0:1789265378.903451:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414319872 00000100:00100000:3.0:1789265378.903457:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414319872 00000100:00100000:3.0:1789265378.903491:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789265378.903498:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103b823450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+9:14322:x1876180414319872:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265378.903771:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103b823450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+9:14322:x1876180414319872:12345-0@lo:502:llog_process_th.0 Request processed in 272us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265378.903778:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789265378.903897:0:14322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1016d45180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14322:1876180414319872:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789265378.903924:0:14322:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789265378.903934:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265378.903937:0:14322:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789265378.903941:0:14322:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1789265378.903943:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789265378.903956:0:14322:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8a1037eccd28) 00000020:00000080:0.0:1789265378.903973:0:14322:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1789265378.903978:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1789265378.904060:0:14322:0:(osd_handler.c:1573:osd_obd_connect()) connect #2 00000020:00000080:0.0:1789265378.904067:0:14322:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x27274ba5bb952ee0 00000020:00000080:0.0:1789265378.904294:0:14322:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1789265378.904299:0:14322:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789265378.904303:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265378.904312:0:14322:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789265378.904315:0:14322:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789265378.904319:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265378.904321:0:14322:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1789265378.904324:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789265378.904331:0:14322:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8a1037ec8000) 00000020:00000080:0.0:1789265378.904340:0:14322:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1789265378.904344:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1789265378.904346:0:14322:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1789265378.904348:0:14322:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1789265378.904354:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789265378.904393:0:14322:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a102eccb800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1789265378.904405:0:14322:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8a10118f0000) 00000020:00000080:0.0:1789265378.904412:0:14322:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1789265378.904450:0:14322:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1789265378.904455:0:14322:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x27274ba5bb952ef5 00000020:00000080:0.0:1789265378.904541:0:14322:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1789265378.904547:0:14322:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1789265378.904551:0:14322:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x27274ba5bb952efc 00080000:01000000:0.0:1789265378.904556:0:14322:0:(osd_handler.c:1573:osd_obd_connect()) connect #3 00000020:00000080:0.0:1789265378.904559:0:14322:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x27274ba5bb952f03 00010000:00010000:2.0:1789265378.997949:0:14322:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1789265378.999575:0:14322:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967527 00000001:00080000:2.0:1789265378.999795:0:14322:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789265379.000699:0:14322:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8a1008f40000) 00000020:00000080:2.0:1789265379.000717:0:14322:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1789265379.000785:0:14322:0:(osd_handler.c:1573:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789265379.000793:0:14322:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x27274ba5bb952f11 00000020:00000080:3.0:1789265379.005604:0:14322:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1789265379.024862:0:14322:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x27274ba5bb952f18 00000020:00000080:3.0:1789265379.025536:0:14322:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1789265379.025548:0:14322:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265379.025554:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265379.025557:0:14322:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1789265379.025562:0:14322:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789265379.025565:0:14322:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1789265379.025573:0:14322:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789265379.025575:0:14322:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789265379.025576:0:14322:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789265379.025579:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265379.025581:0:14322:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789265379.025594:0:14322:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265379.025601:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265379.025603:0:14322:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1789265379.025607:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1789265379.025978:0:14322:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1789265379.025996:0:14322:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265379.026000:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265379.026001:0:14322:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1789265379.026005:0:14322:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789265379.026008:0:14322:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1789265379.026012:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265379.026013:0:14322:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789265379.026016:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789265379.026021:0:14322:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.137@tcp to nid 0x20000c0a8cb89 (192.168.203.137@tcp) 00000020:01000000:3.0:1789265379.026060:0:14322:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789265379.026064:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789265379.026953:0:14322:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8a100878cd28) 00000020:00000080:3.0:1789265379.026977:0:14322:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1789265379.026986:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789265379.027322:0:14322:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1789265379.027330:0:14322:0:(osd_handler.c:1573:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789265379.027338:0:14322:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x27274ba5bb952f26 00010000:00080000:3.0:1789265379.027372:0:14322:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a1004a59800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.137@tcp at head 00010000:00010000:3.0:1789265379.027596:0:14322:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1789265379.031241:0:14322:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789265379.031325:0:14322:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789265379.033694:0:14322:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789265379.033763:0:14322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1789265379.033835:0:14322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1789265379.034646:0:14326:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789265379.034652:0:14326:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1789265379.035702:0:14322:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789265379.035715:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789265379.035750:0:14322:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789265379.035769:0:14322:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x27274ba5bb952f2d 00000100:00080000:3.0:1789265379.035780:0:14322:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789265379.035785:0:14322:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8a1004a59800 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:3.0:1789265379.035823:0:14322:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a0f02da1180 x1876180414320000/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789265379.035957:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1876180414320000:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789265379.036011:0:3314:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876180414320000 offset 0 length 520: 4 00000100:00080000:3.0:1789265379.036295:0:14322:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1789265379.036354:0:14322:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265379.036358:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265379.036360:0:14322:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789265379.036363:0:14322:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789265379.036366:0:14322:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:3.0:1789265379.036368:0:14322:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789265379.036369:0:14322:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789265379.036371:0:14322:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789265379.036373:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265379.036375:0:14322:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789265379.036377:0:14322:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789265379.036380:0:14322:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1789265379.036383:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265379.036384:0:14322:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789265379.036387:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789265379.036391:0:14322:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.137@tcp to nid 0x20000c0a8cb89 (192.168.203.137@tcp) 00000020:01000000:3.0:1789265379.036411:0:14322:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789265379.036414:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789265379.036439:0:14322:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8a10087899b8) 00000020:00000080:3.0:1789265379.036452:0:14322:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1789265379.036457:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789265379.036530:0:14322:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1789265379.036536:0:14322:0:(osd_handler.c:1573:osd_obd_connect()) connect #6 00000020:00000080:3.0:1789265379.036547:0:14322:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x27274ba5bb952f3b 00010000:00080000:3.0:1789265379.036593:0:14322:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a10202a9000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.137@tcp at head 00010000:00010000:3.0:1789265379.036786:0:14322:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1789265379.037497:0:14322:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789265379.037520:0:14322:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789265379.040956:0:14322:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789265379.042703:0:14322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1789265379.042818:0:14322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1789265379.051761:0:14328:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789265379.051770:0:14328:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1789265379.057479:0:14322:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789265379.057493:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789265379.057530:0:14322:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789265379.057549:0:14322:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x27274ba5bb952f42 00000100:00080000:3.0:1789265379.057560:0:14322:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789265379.057565:0:14322:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a10202a9000 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:3.0:1789265379.057608:0:14322:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a0f02da1880 x1876180414320128/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789265379.057685:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1876180414320128:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789265379.057737:0:3314:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876180414320128 offset 0 length 520: 4 00000100:00080000:3.0:1789265379.057788:0:14322:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1789265379.057853:0:14322:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265379.057856:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265379.057858:0:14322:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1789265379.057861:0:14322:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265379.057864:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265379.057866:0:14322:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789265379.057868:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789265379.057870:0:14322:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789265379.057872:0:14322:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265379.057888:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265379.057890:0:14322:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789265379.057892:0:14322:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265379.057895:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265379.057896:0:14322:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789265379.057899:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789265379.057924:0:14322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14322:1876180414320256:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265379.057965:0:14322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265379.057993:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414320256 00000100:00100000:3.0:1789265379.057998:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414320256 00000100:00100000:3.0:1789265379.058038:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789265379.058333:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103b820450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+9:14322:x1876180414320256:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265379.058838:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103b820450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+9:14322:x1876180414320256:12345-0@lo:502:llog_process_th.0 Request processed in 507us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265379.058856:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789265379.058900:0:14322:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a100552d000 going to sleep for 11 seconds 00000100:00100000:3.0:1789265379.058919:0:14322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14322:1876180414320256:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789265379.058946:0:14322:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265379.058951:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265379.058953:0:14322:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789265379.058956:0:14322:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1789265379.059733:0:14286:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:1.0:1789265379.059753:0:14286:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789265379.059774:0:14286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a103fa35600/0x27274ba5bb952ecb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb952ed2 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265379.059786:0:14286:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff8a103fa35600/0x27274ba5bb952ecb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb952ed2 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265379.059795:0:14286:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a102eccb800 from 1 10000000:01000000:1.0:1789265379.059798:0:14286:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789265379.059834:0:14286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a101b596c00/0x27274ba5bb952f49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265379.059856:0:14286:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff8a101b596c00/0x27274ba5bb952f49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265379.059867:0:14286:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff8a101b596c00/0x27274ba5bb952f49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265379.059885:0:14286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02df7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14286:1876180414320384:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789265379.059929:0:14286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265379.059954:0:14286:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a102ee92e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789265379.060544:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414320384 00000100:00100000:2.0:1789265379.060553:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414320384 00000100:00100000:2.0:1789265379.060600:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789265379.060609:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103b823850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+9:14286:x1876180414320384:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789265379.060623:0:14299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265379.060638:0:14299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a103fad6e00/0x27274ba5bb952f50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27274ba5bb952f49 expref: -99 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265379.060661:0:14299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a103fad6e00/0x27274ba5bb952f50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27274ba5bb952f49 expref: 10 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265379.060671:0:14299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a103fad6e00/0x27274ba5bb952f50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb952f49 expref: 10 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265379.060680:0:14299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fad6e00, rc 0) 00000100:00100000:2.0:1789265379.060732:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103b823850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+10:14286:x1876180414320384:12345-0@lo:101:mount.lustre.0 Request processed in 124us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265379.060739:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789265379.060922:0:14286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02df7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14286:1876180414320384:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789265379.060937:0:14286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff8a101b596c00/0x27274ba5bb952f49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb952f50 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265379.060949:0:14286:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff8a101b596c00/0x27274ba5bb952f49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27274ba5bb952f50 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265379.061844:0:14286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14286:1876180414320512:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1789265379.061902:0:14286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265379.061936:0:14286:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a100552d000 going to sleep for 11 seconds 00000100:00100000:2.0:1789265379.062407:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414320512 00000100:00100000:2.0:1789265379.062416:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414320512 00000100:00100000:2.0:1789265379.062456:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789265379.062473:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103b821450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+10:14286:x1876180414320512:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1789265379.062502:0:14297:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789265379.062509:0:14297:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1789265379.062578:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103b821450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+10:14286:x1876180414320512:12345-0@lo:256:mount.lustre.0 Request processed in 107us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265379.062596:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789265379.062690:0:14286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14286:1876180414320512:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1789265379.063269:0:14286:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789265379.063288:0:14286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a101b596c00/0x27274ba5bb952f49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb952f50 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265379.063298:0:14286:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff8a101b596c00/0x27274ba5bb952f49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb952f50 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265379.063307:0:14286:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a102eccb800 from 1 10000000:01000000:1.0:1789265379.063310:0:14286:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789265379.063339:0:14286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a101b596000/0x27274ba5bb952f57 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265379.063347:0:14286:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff8a101b596000/0x27274ba5bb952f57 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265379.063357:0:14286:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff8a101b596000/0x27274ba5bb952f57 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265379.063382:0:14286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02df7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14286:1876180414320640:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789265379.063419:0:14286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265379.063449:0:14286:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a102ee92a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789265379.063474:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414320640 00000100:00100000:1.0:1789265379.063479:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414320640 00000100:00100000:1.0:1789265379.063509:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789265379.063517:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103b821c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+10:14286:x1876180414320640:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789265379.063527:0:14298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265379.063538:0:14298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a101b597e00/0x27274ba5bb952f5e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27274ba5bb952f57 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265379.063558:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a101b597e00/0x27274ba5bb952f5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27274ba5bb952f57 expref: 11 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265379.063568:0:14298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a101b597e00/0x27274ba5bb952f5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb952f57 expref: 11 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265379.063576:0:14298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a101b597e00, rc 0) 00000100:00100000:1.0:1789265379.063615:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103b821c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+11:14286:x1876180414320640:12345-0@lo:101:mount.lustre.0 Request processed in 98us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265379.063621:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789265379.063657:0:14286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02df7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14286:1876180414320640:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789265379.063668:0:14286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff8a101b596000/0x27274ba5bb952f57 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb952f5e expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265379.063676:0:14286:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff8a101b596000/0x27274ba5bb952f57 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27274ba5bb952f5e expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265379.063735:0:14286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02df7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14286:1876180414320768:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789265379.063758:0:14286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265379.063769:0:14286:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a102ee92a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789265379.064516:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414320768 00000100:00100000:2.0:1789265379.064523:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414320768 00000100:00100000:2.0:1789265379.064549:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789265379.064556:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103b823c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+11:14286:x1876180414320768:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789265379.064944:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103b823c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+11:14286:x1876180414320768:12345-0@lo:501:mount.lustre.0 Request processed in 386us (1182us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265379.064952:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789265379.065313:0:14286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02df7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14286:1876180414320768:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789265379.065358:0:14286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14286:1876180414320896:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789265379.065400:0:14286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265379.065432:0:14286:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a100552d540 going to sleep for 11 seconds 00000100:00100000:1.0:1789265379.065688:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414320896 00000100:00100000:1.0:1789265379.065694:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414320896 00000100:00100000:1.0:1789265379.065733:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789265379.065740:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103b820c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+11:14286:x1876180414320896:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789265379.065993:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103b820c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+11:14286:x1876180414320896:12345-0@lo:503:mount.lustre.0 Request processed in 252us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265379.066000:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789265379.067351:0:14286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14286:1876180414320896:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789265379.068377:0:14330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1016d45180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14330:1876180414321024:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789265379.068445:0:14330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265379.068528:0:14330:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1007fe7540 going to sleep for 11 seconds 00000100:00100000:1.0:1789265379.068710:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414321024 00000100:00100000:1.0:1789265379.068717:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414321024 00000100:00100000:1.0:1789265379.068795:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789265379.068804:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103b823050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+11:14330:x1876180414321024:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789265379.069070:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103b823050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+11:14330:x1876180414321024:12345-0@lo:502:llog_process_th.0 Request processed in 267us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265379.069293:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789265379.069379:0:14330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1016d45180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14330:1876180414321024:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789265379.069408:0:14330:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789265379.069417:0:14330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265379.069420:0:14330:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789265379.069429:0:14330:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a102eccb800 00000020:00000080:0.0:1789265379.069432:0:14330:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789265379.069441:0:14330:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789265379.069443:0:14330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265379.069444:0:14330:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789265379.069446:0:14330:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789265379.069449:0:14330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265379.069450:0:14330:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789265379.069453:0:14330:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a102eccb800 00000020:00000080:0.0:1789265379.069455:0:14330:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789265379.069516:0:14330:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789265379.069520:0:14330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265379.069521:0:14330:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789265379.069524:0:14330:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789265379.069526:0:14330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265379.069527:0:14330:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789265379.069530:0:14330:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a102eccb800 00000020:00000080:0.0:1789265379.069531:0:14330:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789265379.069567:0:14330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1016d45180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14330:1876180414321152:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789265379.069625:0:14330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265379.073550:0:14330:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1007fe7540 going to sleep for 11 seconds 00000100:00100000:2.0:1789265379.079946:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414321152 00000100:00100000:2.0:1789265379.079961:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414321152 00000100:00100000:2.0:1789265379.080034:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789265379.080052:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103b822450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+11:14330:x1876180414321152:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265379.080530:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103b822450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+11:14330:x1876180414321152:12345-0@lo:502:llog_process_th.0 Request processed in 486us (10903us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265379.080538:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789265379.080766:0:14330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1016d45180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14330:1876180414321152:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789265379.080802:0:14330:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789265379.080811:0:14330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265379.080813:0:14330:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789265379.080820:0:14330:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1789265379.083467:0:14286:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1789265379.083497:0:14286:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789265379.083557:0:14286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a101b596000/0x27274ba5bb952f57 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb952f5e expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265379.083571:0:14286:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff8a101b596000/0x27274ba5bb952f57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb952f5e expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265379.083627:0:14286:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789265379.083631:0:14286:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8a102eccb800 10000000:01000000:3.0:1789265379.083634:0:14286:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8a102eccb800 10000000:01000000:3.0:1789265379.083638:0:14286:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789265379.083643:0:14286:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a102eccb800 from 1 10000000:01000000:3.0:1789265379.083646:0:14286:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789265379.083681:0:14286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a103fae9a00/0x27274ba5bb952f65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265379.083690:0:14286:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff8a103fae9a00/0x27274ba5bb952f65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265379.083699:0:14286:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff8a103fae9a00/0x27274ba5bb952f65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265379.083732:0:14286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14286:1876180414321280:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789265379.083799:0:14286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265379.083851:0:14286:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a102ec330c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265379.087185:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414321280 00000100:00100000:0.0:1789265379.087205:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414321280 00000100:00100000:0.0:1789265379.087251:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789265379.087260:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103b821850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+11:14286:x1876180414321280:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789265379.087277:0:14299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265379.087294:0:14299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a103fa35400/0x27274ba5bb952f6c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x27274ba5bb952f65 expref: -99 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265379.087320:0:14299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a103fa35400/0x27274ba5bb952f6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27274ba5bb952f65 expref: 12 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265379.087332:0:14299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a103fa35400/0x27274ba5bb952f6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb952f65 expref: 12 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265379.087341:0:14299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fa35400, rc 0) 00000100:00100000:0.0:1789265379.087410:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103b821850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+12:14286:x1876180414321280:12345-0@lo:101:mount.lustre.0 Request processed in 150us (3610us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265379.087416:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789265379.087643:0:14286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14286:1876180414321280:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789265379.087660:0:14286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff8a103fae9a00/0x27274ba5bb952f65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb952f6c expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265379.087670:0:14286:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff8a103fae9a00/0x27274ba5bb952f65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x27274ba5bb952f6c expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265379.087735:0:14286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14286:1876180414321408:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789265379.087768:0:14286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265379.087805:0:14286:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a102ec330c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265379.088956:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414321408 00000100:00100000:0.0:1789265379.088966:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414321408 00000100:00100000:0.0:1789265379.089012:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789265379.089029:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103b820050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+12:14286:x1876180414321408:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789265379.089488:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103b820050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+12:14286:x1876180414321408:12345-0@lo:501:mount.lustre.0 Request processed in 467us (1717us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265379.089496:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789265379.093007:0:14286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14286:1876180414321408:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789265379.096773:0:14286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14286:1876180414321536:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789265379.099746:0:14286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265379.099795:0:14286:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a102ec330c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265379.099929:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414321536 00000100:00100000:0.0:1789265379.099937:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414321536 00000100:00100000:0.0:1789265379.099985:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789265379.099995:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103b822050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+12:14286:x1876180414321536:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789265379.100281:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103b822050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+12:14286:x1876180414321536:12345-0@lo:503:mount.lustre.0 Request processed in 287us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265379.100289:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789265379.100672:0:14286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14286:1876180414321536:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789265379.105553:0:14335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14335:1876180414321664:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265379.105649:0:14335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265379.105695:0:14335:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a102ec33780 going to sleep for 11 seconds 00000100:00100000:1.0:1789265379.105833:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414321664 00000100:00100000:1.0:1789265379.105840:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414321664 00000100:00100000:1.0:1789265379.105884:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789265379.105894:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103b822850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+12:14335:x1876180414321664:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789265379.106303:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103b822850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+12:14335:x1876180414321664:12345-0@lo:502:llog_process_th.0 Request processed in 409us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265379.106311:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789265379.106732:0:14335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14335:1876180414321664:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1789265379.106795:0:14335:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1789265379.106816:0:14335:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8a1008788000) 00000020:00000080:3.0:1789265379.106835:0:14335:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1789265379.106920:0:14335:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a102eccb800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789265379.106924:0:14335:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a102eccb800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789265379.106927:0:14335:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a102eccb800 4 00010000:00080000:3.0:1789265379.106956:0:14335:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a1032cc7000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.137@tcp at head 00010000:00010000:3.0:1789265379.112960:0:14335:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1789265379.113386:0:14335:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1789265379.113426:0:14335:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789265379.113439:0:14335:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x27274ba5bb952f7a 00000100:00080000:3.0:1789265379.113451:0:14335:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789265379.113458:0:14335:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8a1032cc7000 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:3.0:1789265379.113499:0:14335:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a0f02da0000 x1876180414321792/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789265379.113524:0:14335:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789265379.115014:0:14335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14335:1876180414321920:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265379.115216:0:14335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265379.115258:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414321920 00000100:00100000:3.0:1789265379.115265:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414321920 00000100:00100000:3.0:1789265379.115307:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789265379.115316:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103b822c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+12:14335:x1876180414321920:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265379.115548:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103b822c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+12:14335:x1876180414321920:12345-0@lo:502:llog_process_th.0 Request processed in 231us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265379.115555:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789265379.115611:0:14335:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a102ec33e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789265379.115631:0:14335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14335:1876180414321920:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789265379.115657:0:14335:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000100:00100000:0.0:1789265379.116532:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876180414321792:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789265379.116601:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265379.117651:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414321792 00000100:00100000:0.0:1789265379.117660:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414321792 00000100:00100000:0.0:1789265379.117689:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789265379.117696:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1016d45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3314:x1876180414321792:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789265379.117757:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1016d45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3314:x1876180414321792:12345-0@lo:38:llog_process_th.0 Request processed in 61us (1156us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789265379.117764:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789265379.117799:0:3314:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789265379.117806:0:3314:0:(import.c:65:import_set_state_nolock()) ffff8a1032cc7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789265379.117810:0:3314:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789265379.117814:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876180414321792:0@lo:38:llog_process_th.0 00000020:01000000:0.0:1789265379.118652:0:14286:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1789265379.118680:0:14286:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789265379.118735:0:14286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a103fae9a00/0x27274ba5bb952f65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb952f6c expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265379.118748:0:14286:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff8a103fae9a00/0x27274ba5bb952f65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb952f6c expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789265379.118795:0:14286:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789265379.118797:0:14286:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789265379.118798:0:14286:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789265379.118803:0:14286:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789265379.118804:0:14286:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789265379.118806:0:14286:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789265379.118807:0:14286:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789265379.118808:0:14286:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789265379.118810:0:14286:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789265379.118811:0:14286:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789265379.118815:0:14286:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1789265379.118817:0:14286:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789265379.118818:0:14286:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789265379.118819:0:14286:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789265379.118820:0:14286:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789265379.118821:0:14286:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789265379.118822:0:14286:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789265379.118823:0:14286:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789265379.118823:0:14286:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789265379.118824:0:14286:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789265379.118825:0:14286:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789265379.118847:0:14286:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789265379.118864:0:14286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1016d44a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14286:1876180414322048:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789265379.118927:0:14286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265379.118959:0:14286:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1007fe7240 going to sleep for 11 seconds 00000100:00100000:0.0:1789265379.118977:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414322048 00000100:00100000:0.0:1789265379.118982:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414322048 00000100:00100000:0.0:1789265379.119034:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789265379.119052:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008e19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+12:14286:x1876180414322048:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789265379.119096:0:14298:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789265379.119185:0:14298:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789265379.180755:0:14298:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789265379.180817:0:14298:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1789265379.183811:0:14320:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789265379.183821:0:14320:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789265379.183843:0:14320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a103fae9000/0x27274ba5bb952f81 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265379.183862:0:14320:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a103fad6e00/0x27274ba5bb952f50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb952f49 expref: 12 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265379.183871:0:14320:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a103fae9000/0x27274ba5bb952f81 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265379.183920:0:14320:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a103fad6e00/0x27274ba5bb952f50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27274ba5bb952f49 expref: 12 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265379.183937:0:14320:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a103fad6e00/0x27274ba5bb952f50 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27274ba5bb952f49 expref: 12 pid: 14299 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265379.183952:0:14320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da2300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14320:1876180414322176:0@lo:104: 00000100:00100000:3.0:1789265379.184023:0:14320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265379.184090:0:14320:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a102ec33f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789265379.184220:0:14287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414322176 00000100:00100000:0.0:1789265379.184227:0:14287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414322176 00000100:00100000:0.0:1789265379.184274:0:14287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789265379.184283:0:14287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+3:14320:x1876180414322176:12345-0@lo:104: 00010000:00010000:0.0:1789265379.184295:0:14287:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff8a101b596c00/0x27274ba5bb952f49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27274ba5bb952f50 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265379.184358:0:14287:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789265379.184364:0:14287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+3:14320:x1876180414322176:12345-0@lo:104: Request processed in 83us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265379.184371:0:14287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1789265379.184392:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265379.184397:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff8a101b596c00/0x27274ba5bb952f49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27274ba5bb952f50 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265379.184405:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b596c00 already unused, calling callback (ffffffffc1ba2c20) 10000000:00010000:0.0:1789265379.184410:0:14293:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff8a101b596c00/0x27274ba5bb952f49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x27274ba5bb952f50 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265379.184418:0:14293:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff8a101b596c00/0x27274ba5bb952f49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x27274ba5bb952f50 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789265379.184426:0:14293:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff8a101b596c00/0x27274ba5bb952f49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x27274ba5bb952f50 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265379.184431:0:14293:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789265379.184458:0:14293:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff8a101b596c00/0x27274ba5bb952f49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb952f50 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265379.184464:0:14293:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789265379.184483:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff8a101b596c00/0x27274ba5bb952f49 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb952f50 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265379.184489:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff8a101b596c00/0x27274ba5bb952f49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb952f50 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265379.184514:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265379.184516:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265379.184517:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265379.184550:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1016d47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:3315:1876180414322304:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789265379.184578:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265379.184639:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414322304 00000100:00100000:0.0:1789265379.184644:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414322304 00010000:00010000:0.0:1789265379.184662:0:14289:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a103fad6e00/0x27274ba5bb952f50 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27274ba5bb952f49 expref: 13 pid: 14299 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265379.184681:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789265379.184687:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1016d46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+13:3315:x1876180414322304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789265379.184698:0:14289:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265379.184703:0:14289:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a103fad6e00/0x27274ba5bb952f50 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27274ba5bb952f49 expref: 13 pid: 14299 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265379.184714:0:14289:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a103fad6e00/0x27274ba5bb952f50 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27274ba5bb952f49 expref: 13 pid: 14299 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265379.184731:0:14289:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a103fae9000/0x27274ba5bb952f81 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265379.184738:0:14289:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a103fae9000/0x27274ba5bb952f81 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789265379.184750:0:14289:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000930716s 00010000:00010000:0.0:1789265379.184755:0:14289:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a103fae9000/0x27274ba5bb952f81 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265379.184773:0:14289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a103fae9000/0x27274ba5bb952f81 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265379.184779:0:14289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a103fae9000/0x27274ba5bb952f81 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265379.184784:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a103fae9000/0x27274ba5bb952f81 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265379.184789:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fae9000 already unused, calling callback (ffffffffc1581350) 00010000:00010000:0.0:1789265379.184792:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a103fae9000/0x27274ba5bb952f81 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265379.184799:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a103fae9000/0x27274ba5bb952f81 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265379.184807:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a103fae9000/0x27274ba5bb952f81 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265379.184816:0:14289:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265379.184843:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1016d46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+13:3315:x1876180414322304:12345-0@lo:103:ldlm_bl.0 Request processed in 156us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265379.184849:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789265379.184885:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1016d47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:3315:1876180414322304:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789265379.185001:0:14320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a103fad6e00/0x27274ba5bb952f50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27274ba5bb952f49 expref: 12 pid: 14299 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265379.185011:0:14320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da2300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14320:1876180414322176:0@lo:104: 00010000:00010000:3.0:1789265379.185023:0:14320:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a103fae9000/0x27274ba5bb952f81 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265379.185032:0:14320:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a103fae9000/0x27274ba5bb952f81 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265379.185038:0:14320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a103fae9000/0x27274ba5bb952f81 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265379.185051:0:14320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a103fae9000/0x27274ba5bb952f81 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265379.191408:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008e19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+11:14286:x1876180414322048:12345-0@lo:253:mount.lustre.0 Request processed in 72358us (72472us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265379.191422:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789265379.191524:0:14286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1016d44a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14286:1876180414322048:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789265379.191540:0:14286:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789265379.191544:0:14286:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789265379.191546:0:14286:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789265379.191560:0:14286:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789265379.191562:0:14286:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789265379.191563:0:14286:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789265379.191564:0:14286:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789265379.191565:0:14286:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789265379.191567:0:14286:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789265379.191569:0:14286:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789265379.191570:0:14286:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789265379.191635:0:14286:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789265379.197590:0:14286:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1789265379.197770:0:14286:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789265379.198513:0:14286:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1789265379.198671:0:14286:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789265379.198946:0:14286:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1789265379.199359:0:14286:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1789265379.200419:0:14286:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1789265379.200574:0:14286:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1789265379.200848:0:14286:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1789265379.201247:0:14286:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1789265379.201499:0:14286:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1789265379.201665:0:14286:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1789265379.231609:0:14286:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1789265379.235232:0:14286:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1789265379.235510:0:14342:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1789265379.235516:0:14342:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1789265379.235650:0:14343:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1789265379.235750:0:14343:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1789265379.237534:0:14286:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1789265379.237673:0:14286:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1789265379.238171:0:14286:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1789265379.238179:0:14286:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1789265379.238310:0:14286:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789265379.239461:0:14286:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1789265379.241884:0:14343:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789265379.241968:0:14343:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1789265379.241973:0:14343:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:0.0:1789265379.247645:0:14286:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1789265379.247726:0:14286:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:0.0:1789265379.253410:0:14286:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:0.0:1789265379.263866:0:14286:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1789265379.325336:0:14286:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1789265379.325381:0:14286:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa47541753988 00100000:10000000:0.0:1789265379.325389:0:14286:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1789265379.326358:0:14286:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789265379.326375:0:14286:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.137@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789265379.326387:0:14286:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1789265379.326406:0:14286:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1789265379.762225:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789265380.151393:0:14336:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:1.0:1789265380.279990:0:14301:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789265380.279998:0:14301:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a102eccb800 from 6 10000000:01000000:1.0:1789265380.280004:0:14301:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789265380.280053:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a101b596e00/0x27274ba5bb952f88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265380.280064:0:14301:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff8a101b596e00/0x27274ba5bb952f88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265380.280411:0:14301:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff8a101b596e00/0x27274ba5bb952f88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265380.280439:0:14301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02df5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14301:1876180414322432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789265380.280509:0:14301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265380.280618:0:14301:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1011abe3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265380.280975:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414322432 00000100:00100000:0.0:1789265380.280984:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414322432 00000100:00100000:0.0:1789265380.281041:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789265380.281051:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008e1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+11:14301:x1876180414322432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789265380.281065:0:14297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265380.281281:0:14297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a103fa35800/0x27274ba5bb952f8f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27274ba5bb952f88 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265380.281308:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a103fa35800/0x27274ba5bb952f8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27274ba5bb952f88 expref: 12 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265380.281337:0:14297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a103fa35800/0x27274ba5bb952f8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb952f88 expref: 12 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265380.281347:0:14297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fa35800, rc 0) 00000100:00100000:0.0:1789265380.281452:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008e1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+12:14301:x1876180414322432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 402us (943us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265380.281460:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789265380.281527:0:14301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02df5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14301:1876180414322432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789265380.281546:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff8a101b596e00/0x27274ba5bb952f88 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb952f8f expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265380.281567:0:14301:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff8a101b596e00/0x27274ba5bb952f88 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27274ba5bb952f8f expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265380.281763:0:14301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02df5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14301:1876180414322560:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789265380.281801:0:14301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265380.281836:0:14301:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1011abe3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265380.281864:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414322560 00000100:00100000:2.0:1789265380.281870:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414322560 00000100:00100000:2.0:1789265380.281910:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789265380.281919:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008e18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+12:14301:x1876180414322560:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789265380.281935:0:14298:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789265380.281949:0:14298:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789265380.281953:0:14298:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1789265380.282049:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008e18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+12:14301:x1876180414322560:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 130us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265380.282057:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789265380.282067:0:14301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02df5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14301:1876180414322560:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789265380.282314:0:14301:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789265380.282321:0:14301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a101b596e00/0x27274ba5bb952f88 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb952f8f expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265380.282330:0:14301:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff8a101b596e00/0x27274ba5bb952f88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb952f8f expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265380.787491:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789265381.171266:0:14336:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789265381.813248:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265382.837214:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789265383.794888:0:14586:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg337-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789265383.858648:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789265384.242828:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789265384.242835:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789265384.242838:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789265384.242841:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789265384.242844:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789265384.242847:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789265384.242850:0:37:0:(import.c:65:import_set_state_nolock()) ffff8a1032cc7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789265384.242861:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8a1032cc7000 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:3.0:1789265384.242891:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a0f02da3480 x1876180414322816/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789265384.243014:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876180414322816:0@lo:38:kworker.0 00000100:00100000:1.0:1789265384.243106:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265384.243235:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789265384.243245:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:3315:1876180414322688:0@lo:400:kworker.0 00000100:00100000:0.0:1789265384.243278:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265384.243346:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414322688 00000100:00100000:1.0:1789265384.243353:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414322688 00000100:00100000:1.0:1789265384.243395:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789265384.243403:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008e19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+12:3315:x1876180414322688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265384.243444:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008e19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+12:3315:x1876180414322688:12345-0@lo:400:kworker.0 Request processed in 41us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265384.243450:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789265384.243545:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:3315:1876180414322688:0@lo:400:kworker.0 00000100:00100000:3.0:1789265384.243631:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414322816 00000100:00100000:3.0:1789265384.243641:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414322816 00000100:00100000:3.0:1789265384.243666:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789265384.243671:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02df5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3314:x1876180414322816:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1789265384.243690:0:14306:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 430 last 0 00000020:00000080:3.0:1789265384.243722:0:14306:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x27274ba5bb952f96 00000004:00100000:3.0:1789265384.243735:0:14306:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789265384.243848:0:14306:0:(import.c:65:import_set_state_nolock()) ffff8a101109c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789265384.244005:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02df5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876180414322816:12345-0@lo:38:kworker.0 Request processed in 332us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265384.244012:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789265384.247258:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8a0f02da3480 x1876180414322816/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789265394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789265384.247280:0:3314:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789265384.247289:0:3314:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789265384.247294:0:3314:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789265384.247297:0:3314:0:(import.c:65:import_set_state_nolock()) ffff8a1032cc7000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789265384.247304:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876180414322816:0@lo:38:kworker.0 00010000:00010000:3.0:1789265384.882275:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265385.906213:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789265386.688943:0:14736:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc05410340 20000000:00000080:1.0:1789265386.688959:0:14736:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8a102ecf8c00 uarg=0000000000000000 20000000:01000000:1.0:1789265386.689229:0:14736:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1789265386.689235:0:14736:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1789265386.689239:0:14736:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1789265386.689929:0:14737:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:3.0:1789265386.690061:0:14736:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789265386.708818:0:14736:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789265386.710265:0:14736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a103fad6e00/0x27274ba5bb952f9d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265386.710288:0:14736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a101b597e00/0x27274ba5bb952f5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb952f57 expref: 11 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265386.710297:0:14736:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a103fad6e00/0x27274ba5bb952f9d lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265386.710345:0:14736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a101b597e00/0x27274ba5bb952f5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27274ba5bb952f57 expref: 11 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265386.710363:0:14736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a101b597e00/0x27274ba5bb952f5e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27274ba5bb952f57 expref: 11 pid: 14298 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265386.710377:0:14736:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02e31f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14736:1876180414322944:0@lo:104: 00000100:00100000:2.0:1789265386.710452:0:14736:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265386.710515:0:14736:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a100552da80 going to sleep for 11 seconds 00000100:00100000:0.0:1789265386.710691:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414322944 00000100:00100000:0.0:1789265386.710699:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414322944 00000100:00100000:0.0:1789265386.710750:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789265386.710759:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02e33100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+3:14736:x1876180414322944:12345-0@lo:104: 00010000:00010000:0.0:1789265386.710772:0:14288:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff8a101b596000/0x27274ba5bb952f57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27274ba5bb952f5e expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265386.710825:0:14288:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789265386.710831:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02e33100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+3:14736:x1876180414322944:12345-0@lo:104: Request processed in 73us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265386.710838:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1789265386.711052:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265386.711058:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff8a101b596000/0x27274ba5bb952f57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27274ba5bb952f5e expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265386.711071:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b596000 already unused, calling callback (ffffffffc1ba2c20) 10000000:00010000:0.0:1789265386.711101:0:14293:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff8a101b596000/0x27274ba5bb952f57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x27274ba5bb952f5e expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265386.711110:0:14293:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff8a101b596000/0x27274ba5bb952f57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x27274ba5bb952f5e expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789265386.711116:0:14293:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff8a101b596000/0x27274ba5bb952f57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x27274ba5bb952f5e expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265386.711134:0:14293:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789265386.711163:0:14293:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff8a101b596000/0x27274ba5bb952f57 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb952f5e expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265386.711169:0:14293:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789265386.711186:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff8a101b596000/0x27274ba5bb952f57 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb952f5e expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265386.711192:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff8a101b596000/0x27274ba5bb952f57 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb952f5e expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265386.711207:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265386.711209:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265386.711211:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265386.711238:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1016d44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:3317:1876180414323072:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789265386.711268:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265386.711312:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414323072 00000100:00100000:0.0:1789265386.711317:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414323072 00010000:00010000:0.0:1789265386.711334:0:14289:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a101b597e00/0x27274ba5bb952f5e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27274ba5bb952f57 expref: 12 pid: 14298 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265386.711363:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789265386.711370:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1016d47b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+12:3317:x1876180414323072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789265386.711381:0:14289:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265386.711387:0:14289:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a101b597e00/0x27274ba5bb952f5e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27274ba5bb952f57 expref: 12 pid: 14298 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265386.711397:0:14289:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a101b597e00/0x27274ba5bb952f5e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27274ba5bb952f57 expref: 12 pid: 14298 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265386.711424:0:14289:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a103fad6e00/0x27274ba5bb952f9d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265386.711432:0:14289:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a103fad6e00/0x27274ba5bb952f9d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265386.711445:0:14289:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a103fad6e00/0x27274ba5bb952f9d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265386.711452:0:14289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a103fad6e00/0x27274ba5bb952f9d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265386.711459:0:14289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a103fad6e00/0x27274ba5bb952f9d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265386.711466:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a103fad6e00/0x27274ba5bb952f9d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265386.711471:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad6e00 already unused, calling callback (ffffffffc1581350) 00010000:00010000:0.0:1789265386.711475:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a103fad6e00/0x27274ba5bb952f9d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265386.711489:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a103fad6e00/0x27274ba5bb952f9d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265386.711498:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a103fad6e00/0x27274ba5bb952f9d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265386.711507:0:14289:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265386.711549:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1016d47b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+12:3317:x1876180414323072:12345-0@lo:103:ldlm_bl.0 Request processed in 180us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265386.711556:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789265386.711592:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1016d44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:3317:1876180414323072:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789265386.712302:0:14736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a101b597e00/0x27274ba5bb952f5e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27274ba5bb952f57 expref: 11 pid: 14298 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265386.712316:0:14736:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02e31f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14736:1876180414322944:0@lo:104: 00010000:00010000:2.0:1789265386.712333:0:14736:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a103fad6e00/0x27274ba5bb952f9d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265386.712342:0:14736:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a103fad6e00/0x27274ba5bb952f9d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265386.712348:0:14736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a103fad6e00/0x27274ba5bb952f9d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265386.712355:0:14736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a103fad6e00/0x27274ba5bb952f9d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265386.938398:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265387.954397:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789265388.468115:0:14301:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789265388.468126:0:14301:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a102eccb800 from 10 10000000:01000000:2.0:1789265388.468134:0:14301:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789265388.468203:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a103fad7e00/0x27274ba5bb952fa4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265388.468219:0:14301:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff8a103fad7e00/0x27274ba5bb952fa4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265388.468233:0:14301:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff8a103fad7e00/0x27274ba5bb952fa4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265388.468265:0:14301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02e31f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14301:1876180414323200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789265388.468367:0:14301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265388.468443:0:14301:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a100552dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789265388.468748:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414323200 00000100:00100000:0.0:1789265388.468770:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414323200 00000100:00100000:2.0:1789265388.468924:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789265388.468937:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008e18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+11:14301:x1876180414323200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789265388.468955:0:14297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265388.468973:0:14297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a103fad6400/0x27274ba5bb952fab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27274ba5bb952fa4 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265388.469002:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a103fad6400/0x27274ba5bb952fab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27274ba5bb952fa4 expref: 12 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265388.469013:0:14297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a103fad6400/0x27274ba5bb952fab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb952fa4 expref: 12 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265388.469025:0:14297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fad6400, rc 0) 00000100:00100000:2.0:1789265388.469117:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008e18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+12:14301:x1876180414323200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 182us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265388.469124:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789265388.469239:0:14301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02e31f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14301:1876180414323200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265388.469258:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff8a103fad7e00/0x27274ba5bb952fa4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb952fab expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265388.469268:0:14301:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff8a103fad7e00/0x27274ba5bb952fa4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27274ba5bb952fab expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265388.469344:0:14301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14301:1876180414323328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265388.469377:0:14301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265388.469411:0:14301:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1016da2480 going to sleep for 11 seconds 00000100:00100000:2.0:1789265388.469532:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414323328 00000100:00100000:2.0:1789265388.469536:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414323328 00000100:00100000:2.0:1789265388.469572:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789265388.469580:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008e18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+12:14301:x1876180414323328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265388.470161:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008e18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+12:14301:x1876180414323328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 579us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265388.470170:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789265388.472993:0:14301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14301:1876180414323328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265388.473114:0:14301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14301:1876180414323456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789265388.473224:0:14301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265388.473286:0:14301:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1016da2480 going to sleep for 11 seconds 00000100:00100000:3.0:1789265388.475852:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414323456 00000100:00100000:3.0:1789265388.475871:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414323456 00000100:00100000:3.0:1789265388.475958:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789265388.475971:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008e18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+12:14301:x1876180414323456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789265388.476337:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008e18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+12:14301:x1876180414323456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 367us (3112us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265388.476345:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789265388.476417:0:14301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14301:1876180414323456:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789265388.478187:0:14804:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1789265388.478935:0:14301:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1789265388.478962:0:14301:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789265388.478976:0:14301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a103fad7e00/0x27274ba5bb952fa4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb952fab expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265388.478989:0:14301:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff8a103fad7e00/0x27274ba5bb952fa4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb952fab expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265388.980797:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265389.367266:0:3314:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789265379/real 1789265379] req@ffff8a0f02da1880 x1876180414320128/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265389 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265389.367309:0:3314:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a0f02da1880 x1876180414320128/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265389 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265389.367320:0:3314:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789265379/real 1789265379] req@ffff8a0f02da1180 x1876180414320000/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265389 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265389.367333:0:3314:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a0f02da1180 x1876180414320000/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265389 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789265389.367355:0:3314:0:(import.c:65:import_set_state_nolock()) ffff8a10202a9000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789265389.369278:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789265389.369287:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789265389.369291:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789265389.369310:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789265389.369315:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a10202a9000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789265389.369325:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 424 00000100:00080000:0.0:1789265389.369333:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789265389.369341:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a10202a9000 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:0.0:1789265389.369372:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1016d45500 x1876180414323712/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789265389.369450:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1016d44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:3318:1876180414323584:0@lo:400:kworker.0 00000100:00100000:0.0:1789265389.369738:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265389.369837:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1016d44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876180414323840:0@lo:400:kworker.0 00000100:00100000:0.0:1789265389.369870:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265389.369926:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414323840 00000100:00100000:0.0:1789265389.369936:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414323840 00000100:00100000:0.0:1789265389.370054:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789265389.370065:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1016d46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876180414323840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265389.370230:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1016d46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876180414323840:12345-0@lo:400:kworker.0 Request processed in 165us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265389.370239:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789265389.370290:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8a1016d44380 x1876180414323840/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265389.370306:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1016d44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876180414323840:0@lo:400:kworker.0 00000100:00100000:2.0:1789265389.370714:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414323584 00000100:00100000:2.0:1789265389.370721:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414323584 00000100:00100000:2.0:1789265389.370768:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789265389.370777:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008e1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+12:3318:x1876180414323584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265389.370829:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008e1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+12:3318:x1876180414323584:12345-0@lo:400:kworker.0 Request processed in 54us (1092us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265389.370849:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789265389.371338:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1016d44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:3318:1876180414323584:0@lo:400:kworker.0 00000100:00080000:1.0:1789265389.371651:0:3314:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789265389.371659:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1876180414320128:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1789265389.371681:0:3314:0:(import.c:65:import_set_state_nolock()) ffff8a1004a59800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789265389.371712:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789265389.371717:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789265389.371725:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a1004a59800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789265389.371730:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 424 00000100:00080000:0.0:1789265389.371734:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789265389.371740:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8a1004a59800 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:0.0:1789265389.371777:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1016d44a80 x1876180414323968/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789265389.371871:0:3314:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789265389.371876:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1876180414320000:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1789265389.371903:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1016d45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1876180414323712:0@lo:8:kworker.0 00000400:00000100:1.0:1789265389.371967:0:3314:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876180414323712 offset 0 length 520: 4 00000100:00100000:1.0:1789265389.372001:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1016d44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1876180414323968:0@lo:8:kworker.0 00000400:00000100:1.0:1789265389.372021:0:3314:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876180414323968 offset 0 length 520: 4 00010000:00010000:0.0:1789265390.006463:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265391.026860:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789265391.419996:0:14336:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789265392.050587:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789265392.099137:0:14986:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789265392.099141:0:14986:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1789265392.099277:0:14986:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8a103fbb2800 00000020:01000004:3.0:1789265392.099294:0:14986:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1789265392.099306:0:14986:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1789265392.099330:0:14986:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8a1041804d28) 00000020:00000080:3.0:1789265392.099346:0:14986:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1789265392.112769:0:14986:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1789265392.113049:0:14986:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1789265392.113881:0:14986:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1789265392.114322:0:14986:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1789265392.114535:0:14986:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1789265392.114848:0:14986:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 571: rc = 0 00100000:10000000:0.0:1789265392.114938:0:14986:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 571: rc = 0 00100000:10000000:0.0:1789265392.115031:0:14986:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 571: rc = 0 00100000:10000000:0.0:1789265392.115597:0:14986:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 769: rc = 0 00100000:10000000:0.0:1789265392.115837:0:14986:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 769: rc = 0 00100000:10000000:0.0:1789265392.116063:0:14986:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 769: rc = 0 00100000:10000000:1.0:1789265392.116523:0:14986:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 769: rc = 0 00100000:10000000:1.0:1789265392.116749:0:14986:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 769: rc = 0 00100000:10000000:1.0:1789265392.117005:0:14986:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 769: rc = 0 00000020:00000080:1.0:1789265392.117638:0:14986:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1789265392.117649:0:14986:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789265392.117659:0:14986:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x27274ba5bb952fb9 00000020:01000004:1.0:1789265392.117667:0:14986:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1789265392.117687:0:14986:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.137@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789265392.117691:0:14986:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.137@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789265392.117695:0:14986:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1789265392.117700:0:14986:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1789265392.117711:0:14986:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8a10037d3370) 00000020:00000080:1.0:1789265392.117721:0:14986:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:1.0:1789265392.118951:0:14986:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789265392.119330:0:14986:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1789265392.119337:0:14986:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1789265392.123675:0:14986:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1789265392.123690:0:14986:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1789265392.126319:0:14986:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1789265392.126329:0:14986:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1789265392.127756:0:14986:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789265392.127942:0:14986:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1789265392.127948:0:14986:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1789265392.128438:0:14986:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1789265392.128445:0:14986:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1789265392.142749:0:14986:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789265392.142996:0:14986:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789265392.143003:0:14986:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1789265392.144922:0:14986:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789265392.144987:0:14986:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1789265392.146332:0:14986:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789265392.146345:0:14986:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1789265392.148453:0:14986:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789265392.148716:0:14986:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1789265392.148729:0:14986:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1789265392.149412:0:14986:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1789265392.149420:0:14986:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1789265392.188433:0:14986:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789265392.189046:0:14986:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1789265392.189052:0:14986:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1789265392.190611:0:14986:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1789265392.190622:0:14986:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1789265392.193273:0:14986:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1789265392.193308:0:14986:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1789265392.193315:0:14986:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.137@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1789265392.210164:0:14986:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.137@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789265392.210208:0:14986:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.137@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1789265392.210213:0:14986:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789265392.210215:0:14986:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789265392.210217:0:14986:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789265392.210218:0:14986:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789265392.210219:0:14986:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789265392.210220:0:14986:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789265392.210222:0:14986:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789265392.210224:0:14986:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789265392.210225:0:14986:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789265392.210228:0:14986:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1789265392.210231:0:14986:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789265392.210232:0:14986:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789265392.210233:0:14986:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789265392.210234:0:14986:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789265392.210235:0:14986:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789265392.210236:0:14986:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789265392.210237:0:14986:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789265392.210238:0:14986:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789265392.210240:0:14986:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789265392.210266:0:14986:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789265392.210288:0:14986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14986:1876180414324096:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789265392.210357:0:14986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265392.210505:0:14986:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1004866b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789265392.210599:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414324096 00000100:00100000:2.0:1789265392.210606:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414324096 00000100:00100000:2.0:1789265392.210660:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789265392.210669:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008e19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+12:14986:x1876180414324096:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789265392.210696:0:14297:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1789265392.210699:0:14297:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1789265392.210703:0:14297:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1789265392.227539:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008e19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+12:14986:x1876180414324096:12345-0@lo:253:mount.lustre.0 Request processed in 16862us (17173us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265392.227556:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789265392.227658:0:14986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14986:1876180414324096:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789265392.227672:0:14986:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789265392.227676:0:14986:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789265392.227677:0:14986:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789265392.227679:0:14986:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789265392.227680:0:14986:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789265392.227681:0:14986:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789265392.227683:0:14986:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789265392.227697:0:14986:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789265392.227699:0:14986:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789265392.227700:0:14986:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789265392.227718:0:14986:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a103fbb2800 from lustre-OST0000 10000000:01000000:3.0:1789265392.227742:0:14986:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1789265392.227745:0:14986:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789265392.227751:0:14986:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8a100878b370 local copy 00010000:00010000:3.0:1789265392.227762:0:14986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a103fa35c00/0x27274ba5bb952eaf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb952eb6 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265392.228001:0:14986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14986:1876180414324224:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789265392.228038:0:14986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265392.228110:0:14986:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10048663c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265392.228370:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414324224 00000100:00100000:0.0:1789265392.228377:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414324224 00000100:00100000:0.0:1789265392.228418:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789265392.228427:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008e1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+12:14986:x1876180414324224:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789265392.228600:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008e1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+12:14986:x1876180414324224:12345-0@lo:501:mount.lustre.0 Request processed in 174us (561us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789265392.228607:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789265392.228721:0:14986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14986:1876180414324224:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789265392.228736:0:14986:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.137@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789265392.228894:0:14986:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.137@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789265392.228906:0:14986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a103fa35c00/0x27274ba5bb952eaf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb952eb6 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265392.228915:0:14986:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff8a103fa35c00/0x27274ba5bb952eaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb952eb6 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265392.228947:0:14986:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8a103fbb2800 10000000:01000000:1.0:1789265392.228952:0:14986:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789265392.228957:0:14986:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8a100878b370 10000000:01000000:1.0:1789265392.228959:0:14986:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1789265392.228962:0:14986:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a100878b370 from 1 10000000:01000000:1.0:1789265392.228965:0:14986:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789265392.228991:0:14986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a101b596200/0x27274ba5bb952fc7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265392.229000:0:14986:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff8a101b596200/0x27274ba5bb952fc7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265392.229009:0:14986:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff8a101b596200/0x27274ba5bb952fc7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265392.229023:0:14986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02df7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14986:1876180414324352:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789265392.229051:0:14986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265392.229069:0:14986:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10086f2000 going to sleep for 11 seconds 00000100:00100000:2.0:1789265392.229194:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414324352 00000100:00100000:2.0:1789265392.229200:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414324352 00000100:00100000:2.0:1789265392.229233:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789265392.229240:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008e1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+12:14986:x1876180414324352:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789265392.229259:0:14297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265392.229272:0:14297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a103fad6c00/0x27274ba5bb952fce lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27274ba5bb952fc7 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265392.229292:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a103fad6c00/0x27274ba5bb952fce lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27274ba5bb952fc7 expref: 13 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265392.229302:0:14297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a103fad6c00/0x27274ba5bb952fce lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb952fc7 expref: 13 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265392.229311:0:14297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fad6c00, rc 0) 00000100:00100000:2.0:1789265392.229340:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008e1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+13:14986:x1876180414324352:12345-0@lo:101:mount.lustre.0 Request processed in 100us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265392.229346:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789265392.230587:0:14986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02df7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14986:1876180414324352:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789265392.230609:0:14986:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff8a101b596200/0x27274ba5bb952fc7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb952fce expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265392.230621:0:14986:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff8a101b596200/0x27274ba5bb952fc7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27274ba5bb952fce expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265392.230664:0:14986:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789265392.230682:0:14986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a101b596200/0x27274ba5bb952fc7 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb952fce expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265392.230690:0:14986:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff8a101b596200/0x27274ba5bb952fc7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb952fce expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265392.230696:0:14986:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789265392.230701:0:14986:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789265392.230708:0:14986:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1789265392.230710:0:14986:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789265392.230734:0:14986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a101b596000/0x27274ba5bb952fd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265392.230743:0:14986:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff8a101b596000/0x27274ba5bb952fd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265392.230751:0:14986:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff8a101b596000/0x27274ba5bb952fd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265392.230768:0:14986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02df7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14986:1876180414324480:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789265392.230812:0:14986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265392.230846:0:14986:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10086f2000 going to sleep for 11 seconds 00000100:00100000:2.0:1789265392.231046:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414324480 00000100:00100000:2.0:1789265392.231055:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414324480 00000100:00100000:2.0:1789265392.231120:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789265392.231128:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008e1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+13:14986:x1876180414324480:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789265392.231139:0:14297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265392.231150:0:14297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a103fad6600/0x27274ba5bb952fdc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x27274ba5bb952fd5 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265392.231166:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a103fad6600/0x27274ba5bb952fdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27274ba5bb952fd5 expref: 14 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265392.231173:0:14297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a103fad6600/0x27274ba5bb952fdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb952fd5 expref: 14 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265392.231180:0:14297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fad6600, rc 0) 00000100:00100000:2.0:1789265392.231231:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008e1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+14:14986:x1876180414324480:12345-0@lo:101:mount.lustre.0 Request processed in 103us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265392.231237:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789265392.231417:0:14986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02df7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14986:1876180414324480:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789265392.231428:0:14986:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff8a101b596000/0x27274ba5bb952fd5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb952fdc expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265392.231435:0:14986:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff8a101b596000/0x27274ba5bb952fd5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x27274ba5bb952fdc expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789265392.232251:0:14986:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1789265392.234762:0:14986:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789265392.235248:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1789265392.235299:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1789265392.235334:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1789265392.235383:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1789265392.235419:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1789265392.235453:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1789265392.235533:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1789265392.235541:0:14986:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1789265392.235621:0:14986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02df7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14986:1876180414324608:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789265392.235682:0:14986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265392.235716:0:14986:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10086f29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265392.235943:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414324608 00000100:00100000:0.0:1789265392.235951:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414324608 00000100:00100000:0.0:1789265392.236005:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789265392.236015:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008e19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+14:14986:x1876180414324608:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789265392.236387:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008e19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+14:14986:x1876180414324608:12345-0@lo:501:mount.lustre.0 Request processed in 372us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265392.236394:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789265392.237147:0:14986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02df7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14986:1876180414324608:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789265392.237201:0:14986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02df7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14986:1876180414324736:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789265392.237252:0:14986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265392.237327:0:14986:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10086f29c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265392.239730:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414324736 00000100:00100000:3.0:1789265392.239744:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414324736 00000100:00100000:2.0:1789265392.240015:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789265392.240025:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008e1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+14:14986:x1876180414324736:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789265392.240450:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008e1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+14:14986:x1876180414324736:12345-0@lo:503:mount.lustre.0 Request processed in 425us (3196us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265392.240458:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789265392.241345:0:14986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02df7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14986:1876180414324736:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789265392.242348:0:14986:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789265392.242426:0:14986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02e30a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14986:1876180414324864:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789265392.242571:0:14986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265392.243053:0:14986:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1008f5c000 going to sleep for 11 seconds 00000100:00100000:3.0:1789265392.243238:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414324864 00000100:00100000:3.0:1789265392.243245:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414324864 00000100:00100000:2.0:1789265392.243407:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789265392.243417:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008e1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+14:14986:x1876180414324864:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789265392.243836:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008e1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+14:14986:x1876180414324864:12345-0@lo:502:mount.lustre.0 Request processed in 420us (1265us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265392.243844:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789265392.244848:0:14986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02e30a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14986:1876180414324864:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789265392.245296:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1789265392.245366:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1789265392.245399:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1789265392.245447:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1789265392.245577:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1789265392.245616:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1789265392.246217:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1789265392.246617:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1789265392.246654:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1789265392.246709:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1789265392.246748:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1789265392.246796:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1789265392.247203:0:14986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1016d44380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14986:1876180414324992:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789265392.247414:0:14986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265392.247459:0:14986:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1032d38000 going to sleep for 11 seconds 00000100:00100000:2.0:1789265392.247594:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414324992 00000100:00100000:2.0:1789265392.247601:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414324992 00000100:00100000:0.0:1789265392.247741:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789265392.247753:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1005516050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+14:14986:x1876180414324992:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789265392.249243:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1005516050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+14:14986:x1876180414324992:12345-0@lo:502:mount.lustre.0 Request processed in 1486us (1821us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265392.249254:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789265392.249709:0:14986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1016d44380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14986:1876180414324992:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789265392.249901:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1789265392.250032:0:14986:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:0.0:1789265392.251612:0:15000:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789265392.251621:0:15000:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1789265392.251627:0:15000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265392.251629:0:15000:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1789265392.251636:0:15000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789265392.251651:0:15000:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8a10118f4d28) 00000020:00000080:0.0:1789265392.251673:0:15000:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789265392.251679:0:15000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789265392.251778:0:15000:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a103fbb2800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1789265392.251786:0:15000:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789265392.251793:0:15000:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x27274ba5bb952fea 00010000:00010000:0.0:1789265392.258467:0:15000:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:0.0:1789265392.259320:0:15000:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:0.0:1789265392.262459:0:15000:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1789265392.263976:0:15000:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1789265392.263989:0:15000:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265392.263994:0:15000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265392.263998:0:15000:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1789265392.264002:0:15000:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789265392.264005:0:15000:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:3.0:1789265392.264006:0:15000:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789265392.264008:0:15000:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789265392.264009:0:15000:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789265392.264012:0:15000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265392.264013:0:15000:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789265392.264016:0:15000:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265392.264019:0:15000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265392.264020:0:15000:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789265392.264023:0:15000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789265392.264030:0:15000:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789265392.264033:0:15000:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265392.264036:0:15000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265392.264037:0:15000:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789265392.264039:0:15000:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265392.264042:0:15000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265392.264043:0:15000:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789265392.264046:0:15000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1789265392.264123:0:15000:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265392.264126:0:15000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265392.264128:0:15000:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789265392.264131:0:15000:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1789265392.264396:0:14986:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1789265392.264427:0:14986:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789265392.264452:0:14986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a101b596000/0x27274ba5bb952fd5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb952fdc expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265392.264475:0:14986:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff8a101b596000/0x27274ba5bb952fd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb952fdc expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265392.264484:0:14986:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a103fbb2800 from 1 10000000:01000000:2.0:1789265392.264504:0:14986:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789265392.264539:0:14986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a103fad7400/0x27274ba5bb952ff1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265392.264546:0:14986:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff8a103fad7400/0x27274ba5bb952ff1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265392.264557:0:14986:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff8a103fad7400/0x27274ba5bb952ff1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265392.264581:0:14986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02e33800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14986:1876180414325120:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789265392.264643:0:14986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265392.264685:0:14986:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1011950840 going to sleep for 11 seconds 00000100:00100000:3.0:1789265392.264848:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414325120 00000100:00100000:3.0:1789265392.264855:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414325120 00000100:00100000:3.0:1789265392.265025:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789265392.265036:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1005516450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+14:14986:x1876180414325120:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789265392.265049:0:14297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265392.265062:0:14297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a103fae9000/0x27274ba5bb952ff8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x27274ba5bb952ff1 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265392.265099:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a103fae9000/0x27274ba5bb952ff8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27274ba5bb952ff1 expref: 15 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265392.265109:0:14297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a103fae9000/0x27274ba5bb952ff8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb952ff1 expref: 15 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265392.265118:0:14297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fae9000, rc 0) 00000100:00100000:3.0:1789265392.265167:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1005516450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+15:14986:x1876180414325120:12345-0@lo:101:mount.lustre.0 Request processed in 134us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265392.265174:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789265392.265248:0:14986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02e33800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14986:1876180414325120:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789265392.265272:0:14986:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff8a103fad7400/0x27274ba5bb952ff1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb952ff8 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265392.265280:0:14986:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff8a103fad7400/0x27274ba5bb952ff1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x27274ba5bb952ff8 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789265392.265751:0:14986:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1789265392.266317:0:14986:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789265392.266572:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1789265392.266614:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1789265392.266674:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1789265392.266682:0:14986:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1789265392.266742:0:14986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02df4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14986:1876180414325248:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789265392.266998:0:14986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265392.267190:0:14986:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103cd500c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265392.267244:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414325248 00000100:00100000:2.0:1789265392.267252:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414325248 00000100:00100000:2.0:1789265392.267291:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789265392.267300:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1007177c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+15:14986:x1876180414325248:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789265392.267637:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1007177c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+15:14986:x1876180414325248:12345-0@lo:501:mount.lustre.0 Request processed in 336us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265392.267645:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789265392.267731:0:14986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02df4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14986:1876180414325248:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789265392.267839:0:14986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02df4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14986:1876180414325376:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789265392.267879:0:14986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265392.267903:0:14986:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103cd500c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265392.268001:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414325376 00000100:00100000:0.0:1789265392.268006:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414325376 00000100:00100000:0.0:1789265392.268099:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789265392.268108:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1007174c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+15:14986:x1876180414325376:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789265392.268264:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1007174c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+15:14986:x1876180414325376:12345-0@lo:503:mount.lustre.0 Request processed in 157us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265392.268271:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789265392.268573:0:14986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02df4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14986:1876180414325376:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789265392.269052:0:14986:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789265392.269142:0:14986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02df4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14986:1876180414325504:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789265392.269195:0:14986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265392.270093:0:14986:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103cd500c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265392.270174:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414325504 00000100:00100000:2.0:1789265392.270182:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414325504 00000100:00100000:2.0:1789265392.270216:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789265392.270223:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1007175450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+15:14986:x1876180414325504:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789265392.270438:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1007175450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+15:14986:x1876180414325504:12345-0@lo:502:mount.lustre.0 Request processed in 215us (1247us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265392.270445:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789265392.270595:0:14986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02df4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14986:1876180414325504:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789265392.271183:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1789265392.271244:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1789265392.271366:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1789265392.271411:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1789265392.271442:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1789265392.271504:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1789265392.271736:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1789265392.271773:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1789265392.271813:0:14986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14986:1876180414325632:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789265392.271873:0:14986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265392.272025:0:14986:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10048669c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265392.272037:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414325632 00000100:00100000:2.0:1789265392.272043:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414325632 00000100:00100000:2.0:1789265392.272145:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789265392.272153:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1007175c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+15:14986:x1876180414325632:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789265392.273153:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1007175c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+15:14986:x1876180414325632:12345-0@lo:502:mount.lustre.0 Request processed in 998us (1278us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265392.273162:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789265392.273752:0:14986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14986:1876180414325632:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789265392.273891:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1789265392.274015:0:14986:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1789265392.275298:0:15004:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789265392.275310:0:15004:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265392.275312:0:15004:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789265392.275326:0:15004:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a103fbb2800 00000020:00000080:1.0:1789265392.275329:0:15004:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789265392.275376:0:15004:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789265392.275380:0:15004:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265392.275381:0:15004:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789265392.275384:0:15004:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789265392.275388:0:15004:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265392.275389:0:15004:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789265392.275391:0:15004:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a103fbb2800 00000020:00000080:1.0:1789265392.275393:0:15004:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789265392.275446:0:15004:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789265392.275449:0:15004:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265392.275450:0:15004:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789265392.275452:0:15004:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789265392.275455:0:15004:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265392.275456:0:15004:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789265392.275459:0:15004:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a103fbb2800 00000020:00000080:1.0:1789265392.275461:0:15004:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789265392.275628:0:15004:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789265392.275632:0:15004:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265392.275634:0:15004:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789265392.275637:0:15004:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1789265392.275847:0:14986:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1789265392.275868:0:14986:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789265392.275922:0:14986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a103fad7400/0x27274ba5bb952ff1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb952ff8 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265392.275934:0:14986:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff8a103fad7400/0x27274ba5bb952ff1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb952ff8 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265392.275969:0:14986:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789265392.275972:0:14986:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8a103fbb2800 10000000:01000000:3.0:1789265392.275975:0:14986:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8a103fbb2800 10000000:01000000:3.0:1789265392.275979:0:14986:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789265392.275985:0:14986:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a103fbb2800 from 1 10000000:01000000:3.0:1789265392.275987:0:14986:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789265392.276020:0:14986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a103fae9c00/0x27274ba5bb952fff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265392.276034:0:14986:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff8a103fae9c00/0x27274ba5bb952fff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265392.276044:0:14986:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff8a103fae9c00/0x27274ba5bb952fff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265392.276064:0:14986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14986:1876180414325760:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789265392.276139:0:14986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265392.276173:0:14986:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10048669c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265392.276296:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414325760 00000100:00100000:2.0:1789265392.276303:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414325760 00000100:00100000:2.0:1789265392.276347:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789265392.276356:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1007177850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+15:14986:x1876180414325760:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789265392.276369:0:14299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265392.276381:0:14299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a103fad7200/0x27274ba5bb953006 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x27274ba5bb952fff expref: -99 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265392.276403:0:14299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a103fad7200/0x27274ba5bb953006 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27274ba5bb952fff expref: 16 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265392.276414:0:14299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a103fad7200/0x27274ba5bb953006 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb952fff expref: 16 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265392.276422:0:14299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fad7200, rc 0) 00000100:00100000:2.0:1789265392.276458:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1007177850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+16:14986:x1876180414325760:12345-0@lo:101:mount.lustre.0 Request processed in 103us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265392.276471:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789265392.276807:0:14986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14986:1876180414325760:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789265392.276823:0:14986:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff8a103fae9c00/0x27274ba5bb952fff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb953006 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265392.276831:0:14986:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff8a103fae9c00/0x27274ba5bb952fff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x27274ba5bb953006 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789265392.277529:0:14986:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1789265392.280748:0:14986:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789265392.281315:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1789265392.281367:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1789265392.281403:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1789265392.281462:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1789265392.282008:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1789265392.282067:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1789265392.282128:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1789265392.282158:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1789265392.282197:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1789265392.282226:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1789265392.282265:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1789265392.282312:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1789265392.282348:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1789265392.282383:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1789265392.282431:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1789265392.282483:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1789265392.283725:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1789265392.283874:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1789265392.283914:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1789265392.284023:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1789265392.284106:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1789265392.284162:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1789265392.284193:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1789265392.284239:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1789265392.284275:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1789265392.284309:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1789265392.284357:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1789265392.284396:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1789265392.284479:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1789265392.285290:0:14986:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1789265392.285411:0:14986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14986:1876180414325888:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789265392.285477:0:14986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265392.285536:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414325888 00000100:00100000:3.0:1789265392.285544:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414325888 00000100:00100000:3.0:1789265392.285819:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789265392.285827:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102ec4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+16:14986:x1876180414325888:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789265392.286197:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102ec4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+16:14986:x1876180414325888:12345-0@lo:501:mount.lustre.0 Request processed in 370us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265392.286205:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789265392.286244:0:14986:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10048669c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265392.286269:0:14986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14986:1876180414325888:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789265392.286299:0:14986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14986:1876180414326016:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789265392.286339:0:14986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265392.286365:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414326016 00000100:00100000:3.0:1789265392.286369:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414326016 00000100:00100000:3.0:1789265392.286392:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789265392.286397:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102ec4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+16:14986:x1876180414326016:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789265392.286789:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102ec4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+16:14986:x1876180414326016:12345-0@lo:503:mount.lustre.0 Request processed in 390us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265392.286797:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789265392.286832:0:14986:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10048669c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265392.286845:0:14986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14986:1876180414326016:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789265392.287457:0:14986:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789265392.287873:0:14986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14986:1876180414326144:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789265392.288000:0:14986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265392.288145:0:14986:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10054a7cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265392.288202:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414326144 00000100:00100000:2.0:1789265392.288210:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414326144 00000100:00100000:2.0:1789265392.288281:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789265392.288290:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102ec4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+16:14986:x1876180414326144:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789265392.288508:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102ec4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+16:14986:x1876180414326144:12345-0@lo:502:mount.lustre.0 Request processed in 204us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265392.288516:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789265392.290709:0:14986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14986:1876180414326144:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789265392.291053:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1789265392.291133:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1789265392.291168:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1789265392.291213:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1789265392.291252:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1789265392.291312:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1789265392.291352:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1789265392.291386:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1789265392.291432:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1789265392.291468:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1789265392.291528:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1789265392.291592:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1789265392.291630:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1789265392.291664:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1789265392.291713:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1789265392.291763:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1789265392.291797:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1789265392.291841:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1789265392.291874:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1789265392.291903:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1789265392.291961:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1789265392.292001:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1789265392.292035:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1789265392.292113:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1789265392.292153:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1789265392.292182:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1789265392.292229:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1789265392.292262:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1789265392.292294:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1789265392.292341:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1789265392.292378:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1789265392.292425:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1789265392.292459:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1789265392.292519:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1789265392.292570:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1789265392.292619:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1789265392.292652:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1789265392.292686:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1789265392.292732:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1789265392.292767:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1789265392.292815:0:14986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14986:1876180414326272:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789265392.292885:0:14986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265392.292936:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414326272 00000100:00100000:3.0:1789265392.292943:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414326272 00000100:00100000:3.0:1789265392.292988:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789265392.292997:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102ec4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+16:14986:x1876180414326272:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789265392.293214:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102ec4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+16:14986:x1876180414326272:12345-0@lo:502:mount.lustre.0 Request processed in 218us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265392.293221:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789265392.293273:0:14986:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10048669c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265392.293293:0:14986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14986:1876180414326272:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789265392.293358:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1789265392.293367:0:14986:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1789265392.298242:0:15009:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789265392.298260:0:15009:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8a10418019b8) 00000020:00000080:3.0:1789265392.298283:0:15009:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1789265392.298364:0:15009:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a103fbb2800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789265392.298369:0:15009:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a103fbb2800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789265392.298372:0:15009:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a103fbb2800 3 00010000:00080000:3.0:1789265392.298408:0:15009:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a102e520000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.137@tcp at head 00010000:00010000:3.0:1789265392.302051:0:15009:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:0.0:1789265392.303276:0:15009:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1789265392.306383:0:15009:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789265392.306399:0:15009:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x27274ba5bb953014 00000100:00080000:0.0:1789265392.306410:0:15009:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789265392.306417:0:15009:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a102e520000 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:0.0:1789265392.306452:0:15009:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1016d47800 x1876180414326400/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789265392.306476:0:15009:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789265392.306904:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789265392.306910:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789265392.306913:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789265392.306923:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789265392.306975:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02e31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876180414326528:0@lo:400:kworker.0 00000100:00100000:2.0:1789265392.307043:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265392.307873:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1016d47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3314:1876180414326400:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789265392.307937:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265392.308201:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414326528 00000100:00100000:2.0:1789265392.308209:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414326528 00000100:00100000:2.0:1789265392.308249:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414326400 00000100:00100000:2.0:1789265392.308253:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414326400 00000100:00100000:2.0:1789265392.308266:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789265392.308273:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02e30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876180414326528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265392.308345:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02e30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876180414326528:12345-0@lo:400:kworker.0 Request processed in 72us (1302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265392.308353:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789265392.308370:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789265392.308374:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02df4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3314:x1876180414326400:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789265392.308401:0:14305:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 438 last 0 00000020:00000080:2.0:1789265392.308440:0:14305:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x27274ba5bb95301b 00000004:00100000:2.0:1789265392.308455:0:14305:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789265392.308486:0:14305:0:(import.c:65:import_set_state_nolock()) ffff8a103fbb4000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789265392.308540:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02df4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876180414326400:12345-0@lo:38:llog_process_th.0 Request processed in 165us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265392.308557:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789265392.308595:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8a0f02e31180 x1876180414326528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265392.308609:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02e31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876180414326528:0@lo:400:kworker.0 00010000:00080000:1.0:1789265392.314871:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8a1016d47800 x1876180414326400/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789265402 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265392.314886:0:3314:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789265392.314897:0:3314:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1789265392.314905:0:3314:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789265392.314911:0:3314:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789265392.314922:0:3314:0:(import.c:65:import_set_state_nolock()) ffff8a102e520000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789265392.314939:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1016d47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3314:1876180414326400:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1789265392.315756:0:15009:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1789265392.316423:0:14986:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1789265392.316447:0:14986:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789265392.316509:0:14986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a103fae9c00/0x27274ba5bb952fff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb953006 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265392.316521:0:14986:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff8a103fae9c00/0x27274ba5bb952fff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb953006 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789265392.316573:0:14986:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789265392.316575:0:14986:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789265392.316581:0:14986:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789265392.316582:0:14986:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789265392.316583:0:14986:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789265392.316585:0:14986:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789265392.316586:0:14986:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789265392.316588:0:14986:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789265392.316589:0:14986:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789265392.316593:0:14986:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1789265392.316595:0:14986:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789265392.316596:0:14986:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789265392.316597:0:14986:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789265392.316598:0:14986:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789265392.316599:0:14986:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789265392.316600:0:14986:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789265392.316601:0:14986:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789265392.316602:0:14986:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789265392.316603:0:14986:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789265392.316625:0:14986:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789265392.316653:0:14986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14986:1876180414326656:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789265392.316718:0:14986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265392.316761:0:14986:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a100552d000 going to sleep for 11 seconds 00000100:00100000:0.0:1789265392.317244:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414326656 00000100:00100000:0.0:1789265392.317252:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414326656 00000100:00100000:3.0:1789265392.317372:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789265392.317384:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102ec4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+16:14986:x1876180414326656:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789265392.317428:0:14298:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789265392.317441:0:14298:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789265392.343107:0:14298:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789265392.343122:0:14298:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1789265392.343166:0:14320:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789265392.343171:0:14320:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789265392.343204:0:14320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a103fad7000/0x27274ba5bb953022 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265392.343224:0:14320:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a103fa35800/0x27274ba5bb952f8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb952f88 expref: 16 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265392.343232:0:14320:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a103fad7000/0x27274ba5bb953022 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265392.343272:0:14320:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a103fa35800/0x27274ba5bb952f8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27274ba5bb952f88 expref: 16 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265392.343288:0:14320:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a103fa35800/0x27274ba5bb952f8f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27274ba5bb952f88 expref: 16 pid: 14297 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265392.343508:0:14320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02e31180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14320:1876180414326784:0@lo:104: 00000100:00100000:2.0:1789265392.343575:0:14320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265392.343624:0:14320:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a102ec33600 going to sleep for 11 seconds 00000100:00100000:1.0:1789265392.343701:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414326784 00000100:00100000:1.0:1789265392.343710:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414326784 00000100:00100000:1.0:1789265392.343758:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789265392.343767:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02e30e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+3:14320:x1876180414326784:12345-0@lo:104: 00010000:00010000:1.0:1789265392.343780:0:14288:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff8a101b596e00/0x27274ba5bb952f88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27274ba5bb952f8f expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265392.343827:0:14288:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789265392.343833:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02e30e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+3:14320:x1876180414326784:12345-0@lo:104: Request processed in 68us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265392.343840:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1789265392.344019:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265392.344025:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff8a101b596e00/0x27274ba5bb952f88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27274ba5bb952f8f expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265392.344033:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b596e00 already unused, calling callback (ffffffffc1ba2c20) 10000000:00010000:2.0:1789265392.344046:0:14292:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff8a101b596e00/0x27274ba5bb952f88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x27274ba5bb952f8f expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265392.344054:0:14292:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff8a101b596e00/0x27274ba5bb952f88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x27274ba5bb952f8f expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265392.344061:0:14292:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff8a101b596e00/0x27274ba5bb952f88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x27274ba5bb952f8f expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265392.344067:0:14292:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789265392.344120:0:14292:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff8a101b596e00/0x27274ba5bb952f88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb952f8f expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265392.344128:0:14292:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265392.344150:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff8a101b596e00/0x27274ba5bb952f88 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb952f8f expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265392.344157:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff8a101b596e00/0x27274ba5bb952f88 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb952f8f expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265392.344172:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265392.344181:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265392.344183:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265392.344373:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02e31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:3317:1876180414326912:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789265392.344408:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265392.344461:0:14291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414326912 00000100:00100000:2.0:1789265392.344466:0:14291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414326912 00010000:00010000:2.0:1789265392.344484:0:14291:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a103fa35800/0x27274ba5bb952f8f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27274ba5bb952f88 expref: 17 pid: 14297 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265392.344520:0:14291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789265392.344528:0:14291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02e30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+17:3317:x1876180414326912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789265392.344538:0:14291:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265392.344542:0:14291:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a103fa35800/0x27274ba5bb952f8f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27274ba5bb952f88 expref: 17 pid: 14297 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265392.344554:0:14291:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a103fa35800/0x27274ba5bb952f8f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27274ba5bb952f88 expref: 17 pid: 14297 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265392.344570:0:14291:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a103fad7000/0x27274ba5bb953022 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265392.344578:0:14291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a103fad7000/0x27274ba5bb953022 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789265392.344591:0:14291:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001420956s 00010000:00010000:2.0:1789265392.344596:0:14291:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a103fad7000/0x27274ba5bb953022 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265392.344604:0:14291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a103fad7000/0x27274ba5bb953022 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265392.344620:0:14291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a103fad7000/0x27274ba5bb953022 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265392.344627:0:14291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a103fad7000/0x27274ba5bb953022 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265392.344632:0:14291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad7000 already unused, calling callback (ffffffffc1581350) 00010000:00010000:2.0:1789265392.344636:0:14291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a103fad7000/0x27274ba5bb953022 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265392.344748:0:14291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a103fad7000/0x27274ba5bb953022 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265392.344760:0:14291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a103fad7000/0x27274ba5bb953022 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265392.344769:0:14291:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265392.344801:0:14291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02e30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+17:3317:x1876180414326912:12345-0@lo:103:ldlm_bl.0 Request processed in 274us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265392.344807:0:14291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789265392.344837:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02e31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:3317:1876180414326912:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789265392.344860:0:14320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a103fa35800/0x27274ba5bb952f8f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27274ba5bb952f88 expref: 16 pid: 14297 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265392.344869:0:14320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02e31180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14320:1876180414326784:0@lo:104: 00010000:00010000:2.0:1789265392.344879:0:14320:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a103fad7000/0x27274ba5bb953022 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265392.344896:0:14320:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a103fad7000/0x27274ba5bb953022 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265392.344902:0:14320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a103fad7000/0x27274ba5bb953022 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265392.344908:0:14320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a103fad7000/0x27274ba5bb953022 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265392.353275:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102ec4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+15:14986:x1876180414326656:12345-0@lo:253:mount.lustre.0 Request processed in 35885us (36548us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265392.353289:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789265392.353407:0:14986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14986:1876180414326656:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789265392.353421:0:14986:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789265392.353425:0:14986:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789265392.353427:0:14986:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789265392.353428:0:14986:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789265392.353429:0:14986:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789265392.353430:0:14986:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789265392.353432:0:14986:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789265392.353433:0:14986:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789265392.353435:0:14986:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789265392.353450:0:14986:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789265392.353464:0:14986:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789265392.359803:0:14986:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1789265392.360121:0:14986:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789265392.360277:0:14986:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1789265392.361134:0:14986:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789265392.361448:0:14986:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1789265392.362050:0:14986:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1789265392.363471:0:14986:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1789265392.442217:0:14986:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1789265392.442225:0:14986:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1789265392.442257:0:14986:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789265392.442314:0:14986:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.137@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789265392.442331:0:14986:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1789265392.442357:0:14986:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1789265393.075244:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789265393.461512:0:14301:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789265393.461519:0:14301:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a102eccb800 from 7 10000000:01000000:0.0:1789265393.461524:0:14301:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789265393.461568:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a103fa34e00/0x27274ba5bb953029 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265393.461586:0:14301:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff8a103fa34e00/0x27274ba5bb953029 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265393.461598:0:14301:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff8a103fa34e00/0x27274ba5bb953029 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265393.461623:0:14301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1016d46a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14301:1876180414327040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789265393.461702:0:14301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265393.461875:0:14301:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103bb4f480 going to sleep for 11 seconds 00000100:00100000:3.0:1789265393.462356:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414327040 00000100:00100000:3.0:1789265393.462364:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414327040 00000100:00100000:3.0:1789265393.462414:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789265393.462423:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102ec4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+15:14301:x1876180414327040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265393.462437:0:14299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265393.462451:0:14299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a103fae8800/0x27274ba5bb953030 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27274ba5bb953029 expref: -99 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265393.462473:0:14299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a103fae8800/0x27274ba5bb953030 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27274ba5bb953029 expref: 16 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265393.462484:0:14299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a103fae8800/0x27274ba5bb953030 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb953029 expref: 16 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265393.462501:0:14299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fae8800, rc 0) 00000100:00100000:3.0:1789265393.462551:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102ec4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+16:14301:x1876180414327040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265393.462558:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789265393.462602:0:14301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1016d46a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14301:1876180414327040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265393.462615:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff8a103fa34e00/0x27274ba5bb953029 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb953030 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265393.462651:0:14301:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff8a103fa34e00/0x27274ba5bb953029 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27274ba5bb953030 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265393.462700:0:14301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14301:1876180414327168:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789265393.462731:0:14301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265393.462871:0:14301:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a102eb77180 going to sleep for 11 seconds 00000100:00100000:1.0:1789265393.462937:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414327168 00000100:00100000:1.0:1789265393.462942:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414327168 00000100:00100000:1.0:1789265393.462972:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789265393.462979:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102ec4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+16:14301:x1876180414327168:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789265393.462994:0:14298:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789265393.463011:0:14298:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789265393.463014:0:14298:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1789265393.463139:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102ec4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+16:14301:x1876180414327168:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 159us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265393.463147:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789265393.463271:0:14301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14301:1876180414327168:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789265393.463320:0:14301:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789265393.463332:0:14301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a103fa34e00/0x27274ba5bb953029 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb953030 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265393.463340:0:14301:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff8a103fa34e00/0x27274ba5bb953029 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb953030 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265394.099218:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265395.122282:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265396.168733:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265397.170193:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789265397.558300:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789265397.558307:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789265397.558310:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789265397.558312:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789265397.558358:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:3318:1876180414327296:0@lo:400:kworker.0 00000100:00100000:3.0:1789265397.558426:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265397.558505:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876180414327424:0@lo:400:kworker.0 00000100:00100000:3.0:1789265397.558538:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265397.558559:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789265397.558565:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1876180414327552:0@lo:400:kworker.0 00000100:00100000:3.0:1789265397.558604:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265397.558638:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414327424 00000100:00100000:3.0:1789265397.558645:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414327424 00000100:00100000:3.0:1789265397.558689:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414327552 00000100:00100000:3.0:1789265397.558693:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414327552 00000100:00100000:3.0:1789265397.558717:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789265397.558725:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876180414327424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265397.558777:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876180414327424:12345-0@lo:400:kworker.0 Request processed in 51us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265397.558793:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789265397.558809:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789265397.558815:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876180414327552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265397.558844:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876180414327552:12345-0@lo:400:kworker.0 Request processed in 29us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265397.558850:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789265397.558888:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a0f02da0380 x1876180414327552/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265397.558901:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1876180414327552:0@lo:400:kworker.0 00010000:00080000:3.0:1789265397.558911:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a0f02da3100 x1876180414327424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265397.558918:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876180414327424:0@lo:400:kworker.0 00000100:00100000:1.0:1789265397.559763:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414327296 00000100:00100000:1.0:1789265397.559772:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414327296 00000100:00100000:1.0:1789265397.559817:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789265397.559826:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102ec4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+16:3318:x1876180414327296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265397.559882:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102ec4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+16:3318:x1876180414327296:12345-0@lo:400:kworker.0 Request processed in 57us (1455us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265397.559889:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:0.0:1789265397.560139:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265397.560397:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:3318:1876180414327296:0@lo:400:kworker.0 00010000:00010000:3.0:1789265398.194382:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265399.221708:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789265399.781802:0:15355:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg337-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789265400.244409:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265401.266934:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789265401.653582:0:14336:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789265402.291175:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789265402.675275:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789265402.675282:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789265402.675285:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789265402.675287:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789265402.675327:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02e31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:3317:1876180414327680:0@lo:400:kworker.0 00000100:00100000:2.0:1789265402.675409:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265402.675465:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789265402.675472:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02e31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876180414327808:0@lo:400:kworker.0 00000100:00100000:2.0:1789265402.675499:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265402.675540:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02e32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1876180414327936:0@lo:400:kworker.0 00000100:00100000:2.0:1789265402.675581:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265402.675619:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414327808 00000100:00100000:2.0:1789265402.675626:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414327808 00000100:00100000:2.0:1789265402.675661:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414327936 00000100:00100000:2.0:1789265402.675664:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414327936 00000100:00100000:2.0:1789265402.675687:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789265402.675695:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02e32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876180414327808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265402.675747:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02e32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876180414327808:12345-0@lo:400:kworker.0 Request processed in 52us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265402.675754:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789265402.675770:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789265402.675777:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02e30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876180414327936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265402.675808:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02e30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876180414327936:12345-0@lo:400:kworker.0 Request processed in 32us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265402.675814:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789265402.675850:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a0f02e32a00 x1876180414327936/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265402.675863:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02e32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1876180414327936:0@lo:400:kworker.0 00010000:00080000:2.0:1789265402.675890:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a0f02e31c00 x1876180414327808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265402.675910:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02e31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876180414327808:0@lo:400:kworker.0 00000100:00100000:0.0:1789265402.676010:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414327680 00000100:00100000:0.0:1789265402.676015:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414327680 00000100:00100000:0.0:1789265402.676040:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789265402.676047:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102ec4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+16:3317:x1876180414327680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265402.676106:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102ec4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+16:3317:x1876180414327680:12345-0@lo:400:kworker.0 Request processed in 59us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265402.676112:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:0.0:1789265402.676136:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265402.676151:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02e31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:3317:1876180414327680:0@lo:400:kworker.0 00010000:00010000:2.0:1789265403.314182:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265404.339325:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265404.594219:0:3314:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789265389/real 1789265389] req@ffff8a1016d45500 x1876180414323712/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265404 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265404.594259:0:3314:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a1016d45500 x1876180414323712/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265404 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265404.594270:0:3314:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789265389/real 1789265389] req@ffff8a1016d44a80 x1876180414323968/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265404 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265404.594314:0:3314:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a1016d44a80 x1876180414323968/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265404 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789265404.594339:0:3314:0:(import.c:65:import_set_state_nolock()) ffff8a10202a9000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789265404.594403:0:3314:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789265404.594408:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1016d45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1876180414323712:0@lo:8:kworker.0 00000100:00080000:3.0:1789265404.594423:0:3314:0:(import.c:65:import_set_state_nolock()) ffff8a1004a59800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789265404.595936:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789265404.595944:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789265404.595948:0:37:0:(import.c:65:import_set_state_nolock()) ffff8a1004a59800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789265404.595967:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 435 00000100:00080000:2.0:1789265404.595973:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789265404.595982:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8a1004a59800 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:2.0:1789265404.596013:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a0f02e32a00 x1876180414328192/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789265404.596026:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789265404.596029:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789265404.596031:0:37:0:(import.c:65:import_set_state_nolock()) ffff8a10202a9000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789265404.596034:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 435 00000100:00080000:2.0:1789265404.596036:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789265404.596040:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a10202a9000 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:2.0:1789265404.596049:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a0f02e31880 x1876180414328320/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789265404.596130:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02e31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:3316:1876180414328064:0@lo:400:kworker.0 00000100:00100000:2.0:1789265404.596217:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265404.596314:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02e33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876180414328448:0@lo:400:kworker.0 00000100:00100000:2.0:1789265404.596346:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265404.596369:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789265404.596391:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02e32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1876180414328576:0@lo:400:kworker.0 00000100:00100000:2.0:1789265404.596428:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265404.596462:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414328448 00000100:00100000:2.0:1789265404.596470:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414328448 00000100:00100000:2.0:1789265404.596520:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414328576 00000100:00100000:2.0:1789265404.596523:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414328576 00000100:00100000:2.0:1789265404.596553:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789265404.596561:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02e33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876180414328448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265404.596618:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02e33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876180414328448:12345-0@lo:400:kworker.0 Request processed in 57us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265404.596626:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789265404.596645:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789265404.596651:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02e31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876180414328576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265404.596679:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02e31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876180414328576:12345-0@lo:400:kworker.0 Request processed in 29us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265404.596685:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1789265404.596707:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789265404.596738:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a0f02e32d80 x1876180414328576/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265404.596753:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02e32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1876180414328576:0@lo:400:kworker.0 00010000:00080000:2.0:1789265404.596762:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a0f02e33480 x1876180414328448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265404.596770:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02e33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876180414328448:0@lo:400:kworker.0 00000100:00100000:2.0:1789265404.596819:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414328064 00000100:00100000:2.0:1789265404.596824:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414328064 00000100:00100000:2.0:1789265404.596854:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789265404.596869:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102ec4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+16:3316:x1876180414328064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265404.596907:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102ec4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+16:3316:x1876180414328064:12345-0@lo:400:kworker.0 Request processed in 39us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265404.596913:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789265404.596947:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02e31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:3316:1876180414328064:0@lo:400:kworker.0 00000100:00080000:3.0:1789265404.597356:0:3314:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789265404.597365:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1016d44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1876180414323968:0@lo:8:kworker.0 00000100:00100000:3.0:1789265404.597395:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02e32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1876180414328192:0@lo:8:kworker.0 00000100:00100000:3.0:1789265404.597456:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265404.597486:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02e31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1876180414328320:0@lo:8:kworker.0 00000100:00100000:3.0:1789265404.597514:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265404.603917:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414328192 00000100:00100000:1.0:1789265404.603941:0:14987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414328192 00000100:00100000:1.0:1789265404.604029:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414328320 00000100:00100000:1.0:1789265404.604033:0:14987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414328320 00000100:00100000:0.0:1789265404.604185:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789265404.604197:0:14990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3314:x1876180414328192:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1789265404.604239:0:14990:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 450 last 0 00000020:00000080:0.0:1789265404.607680:0:14990:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x27274ba5bb953037 00002000:00100000:0.0:1789265404.607721:0:14990:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8a1037ed3800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113969 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1789265404.607754:0:14990:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1789265404.607758:0:14990:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789265404.608453:0:14990:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789265404.608505:0:14990:0:(import.c:65:import_set_state_nolock()) ffff8a1037ed1000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789265404.608788:0:14990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3314:x1876180414328192:12345-0@lo:8:kworker.0 Request processed in 4589us (11329us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265404.608800:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789265404.608834:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789265404.608909:0:14990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3314:x1876180414328320:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1789265404.608935:0:14990:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789265404.608972:0:14990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3314:x1876180414328320:12345-0@lo:8:kworker.0 Request processed in 130us (11457us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789265404.608980:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789265404.611560:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a0f02e32a00 x1876180414328192/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789265424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265404.611579:0:3314:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789265404.611592:0:3314:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1789265404.611604:0:3314:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789265404.611611:0:3314:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1789265404.611615:0:3314:0:(import.c:65:import_set_state_nolock()) ffff8a1004a59800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789265404.611650:0:3314:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789265404.611658:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02e32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1876180414328192:0@lo:8:kworker.0 00000100:00080000:3.0:1789265404.611676:0:3314:0:(import.c:65:import_set_state_nolock()) ffff8a10202a9000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789265404.611681:0:3314:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789265404.611694:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02e31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1876180414328320:0@lo:8:kworker.0 00000004:00080000:0.0:1789265404.611827:0:14327:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:0.0:1789265404.611999:0:14327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1016d44700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14327:1876180414328832:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1789265404.612124:0:14327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265404.612163:0:14327:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a102ec33c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789265404.612180:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789265404.612191:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1016d47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414328704:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789265404.612221:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265404.612259:0:14989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414328832 00000100:00100000:0.0:1789265404.612267:0:14989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414328832 00000100:00100000:3.0:1789265404.612732:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414328704 00000100:00100000:3.0:1789265404.612737:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414328704 00000004:00080000:1.0:1789265404.612796:0:14326:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1789265404.614259:0:14989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000004:00080000:1.0:1789265404.614773:0:14326:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 450419695908ns, next at 0ns, rc = 0 00000100:00100000:3.0:1789265404.615043:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789265404.615055:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1016d45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3316:x1876180414328704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789265404.615114:0:14991:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789265404.615225:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1016d45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3316:x1876180414328704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 173us (3002us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265404.615231:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789265404.616012:0:14989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1016d45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14327:x1876180414328832:12345-0@lo:5:osp-pre-0-0.0 00010000:00080000:3.0:1789265404.616392:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a1016d47480 x1876180414328704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265420 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265404.616428:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1016d47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414328704:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789265404.626673:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:0.0:1789265404.675219:0:14989:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1789265404.675251:0:14989:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1789265404.675259:0:14989:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:2.0:1789265404.705430:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789265404.705446:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a060367c/0x27274ba5bb95303e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.705464:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=450s v=(0 0) 00010000:00010000:2.0:1789265404.705469:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265404.705475:0:14989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a060367c/0x27274ba5bb95303e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.705492:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a060367c/0x27274ba5bb95303e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.705502:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a060367c/0x27274ba5bb95303e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.705511:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a060367c/0x27274ba5bb95303e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.705539:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789265404.706163:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789265404.706171:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000308751ef/0x27274ba5bb953045 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.706188:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=450s v=(0 0) 00010000:00010000:2.0:1789265404.706192:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265404.706197:0:14989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000308751ef/0x27274ba5bb953045 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.706208:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000308751ef/0x27274ba5bb953045 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.706216:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000308751ef/0x27274ba5bb953045 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.706225:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000308751ef/0x27274ba5bb953045 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.706246:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789265404.706262:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789265404.706268:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a060367c/0x27274ba5bb95303e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.706277:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad6200 already unused, calling callback (ffffffffc1581350) 00010000:00010000:2.0:1789265404.706281:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a060367c/0x27274ba5bb95303e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.706291:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a060367c/0x27274ba5bb95303e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.706321:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a060367c/0x27274ba5bb95303e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.706330:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a060367c/0x27274ba5bb95303e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.706347:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265404.706351:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000308751ef/0x27274ba5bb953045 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.706358:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad7600 already unused, calling callback (ffffffffc1581350) 00010000:00010000:2.0:1789265404.706361:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000308751ef/0x27274ba5bb953045 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.706369:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000308751ef/0x27274ba5bb953045 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.706379:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000308751ef/0x27274ba5bb953045 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.706387:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000308751ef/0x27274ba5bb953045 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.706399:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265404.706401:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265404.706419:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789265404.706831:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789265404.706838:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a50af5/0x27274ba5bb95304c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.706847:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=450s v=(0 0) 00010000:00010000:2.0:1789265404.706851:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265404.706856:0:14989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072a50af5/0x27274ba5bb95304c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.706866:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072a50af5/0x27274ba5bb95304c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.706874:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a50af5/0x27274ba5bb95304c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.706882:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072a50af5/0x27274ba5bb95304c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.706897:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789265404.706907:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265404.706911:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072a50af5/0x27274ba5bb95304c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.706918:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad6e00 already unused, calling callback (ffffffffc1581350) 00010000:00010000:2.0:1789265404.706922:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a50af5/0x27274ba5bb95304c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.711015:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a50af5/0x27274ba5bb95304c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.711045:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072a50af5/0x27274ba5bb95304c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.711055:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072a50af5/0x27274ba5bb95304c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.711111:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265404.711113:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265404.711116:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789265404.711770:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789265404.711778:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004552a9a5/0x27274ba5bb953053 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.711791:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=450s v=(0 0) 00010000:00010000:2.0:1789265404.711796:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265404.711802:0:14989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004552a9a5/0x27274ba5bb953053 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.711814:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004552a9a5/0x27274ba5bb953053 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.711822:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004552a9a5/0x27274ba5bb953053 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.711836:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004552a9a5/0x27274ba5bb953053 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265404.712092:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265404.714393:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789265404.715161:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789265404.715172:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083a294f4/0x27274ba5bb95305a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.715190:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=450s v=(0 0) 00010000:00010000:2.0:1789265404.715194:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265404.715201:0:14989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083a294f4/0x27274ba5bb95305a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.715214:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083a294f4/0x27274ba5bb95305a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.715224:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083a294f4/0x27274ba5bb95305a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.715231:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000083a294f4/0x27274ba5bb95305a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265404.717098:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789265404.717115:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004552a9a5/0x27274ba5bb953053 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265404.717128:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad6a00 already unused, calling callback (ffffffffc1581350) 00010000:00010000:0.0:1789265404.717133:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004552a9a5/0x27274ba5bb953053 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265404.717143:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004552a9a5/0x27274ba5bb953053 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265404.717168:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004552a9a5/0x27274ba5bb953053 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265404.717175:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004552a9a5/0x27274ba5bb953053 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265404.717199:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265404.717203:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000083a294f4/0x27274ba5bb95305a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265404.717210:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad7800 already unused, calling callback (ffffffffc1581350) 00010000:00010000:0.0:1789265404.717213:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000083a294f4/0x27274ba5bb95305a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265404.717240:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000083a294f4/0x27274ba5bb95305a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265404.717251:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000083a294f4/0x27274ba5bb95305a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265404.717261:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265404.717263:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265404.717265:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265404.719145:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789265404.719158:0:14989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083a294f4/0x27274ba5bb95305a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789265404.719982:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789265404.719991:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000308751ef/0x27274ba5bb953061 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.720006:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=450s v=(0 0) 00010000:00010000:2.0:1789265404.720012:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265404.720019:0:14989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000308751ef/0x27274ba5bb953061 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.720033:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000308751ef/0x27274ba5bb953061 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.720043:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000308751ef/0x27274ba5bb953061 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.720051:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000308751ef/0x27274ba5bb953061 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.720100:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789265404.720839:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789265404.720850:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a060367c/0x27274ba5bb953068 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.720864:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=450s v=(0 0) 00010000:00010000:2.0:1789265404.720868:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265404.720880:0:14989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a060367c/0x27274ba5bb953068 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.720890:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a060367c/0x27274ba5bb953068 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.720898:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a060367c/0x27274ba5bb953068 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.720904:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a060367c/0x27274ba5bb953068 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.720913:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1789265404.721392:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789265404.721399:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047cf9bb0/0x27274ba5bb95306f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.721408:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=450s v=(0 0) 00010000:00010000:2.0:1789265404.721425:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265404.721430:0:14989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047cf9bb0/0x27274ba5bb95306f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.721440:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047cf9bb0/0x27274ba5bb95306f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.721448:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047cf9bb0/0x27274ba5bb95306f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.721467:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047cf9bb0/0x27274ba5bb95306f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.721476:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1789265404.721847:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789265404.721853:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003db7106f/0x27274ba5bb953076 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.721862:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=450s v=(0 0) 00010000:00010000:2.0:1789265404.721865:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265404.721869:0:14989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003db7106f/0x27274ba5bb953076 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.721878:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003db7106f/0x27274ba5bb953076 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.721886:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003db7106f/0x27274ba5bb953076 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.721893:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003db7106f/0x27274ba5bb953076 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.721902:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1789265404.722378:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789265404.722384:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037bbf9fc/0x27274ba5bb95307d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.722400:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=450s v=(0 0) 00010000:00010000:2.0:1789265404.722404:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265404.723261:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789265404.723275:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000308751ef/0x27274ba5bb953061 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265404.723291:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad7600 already unused, calling callback (ffffffffc1581350) 00010000:00010000:1.0:1789265404.723297:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000308751ef/0x27274ba5bb953061 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265404.723331:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000308751ef/0x27274ba5bb953061 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265404.723361:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000308751ef/0x27274ba5bb953061 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265404.723369:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000308751ef/0x27274ba5bb953061 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265404.723394:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789265404.723398:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a060367c/0x27274ba5bb953068 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265404.723404:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad6200 already unused, calling callback (ffffffffc1581350) 00010000:00010000:1.0:1789265404.723408:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a060367c/0x27274ba5bb953068 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265404.723427:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a060367c/0x27274ba5bb953068 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265404.723438:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a060367c/0x27274ba5bb953068 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265404.723445:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a060367c/0x27274ba5bb953068 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265404.723472:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789265404.723477:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047cf9bb0/0x27274ba5bb95306f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265404.723484:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad6800 already unused, calling callback (ffffffffc1581350) 00010000:00010000:1.0:1789265404.723488:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047cf9bb0/0x27274ba5bb95306f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265404.723496:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047cf9bb0/0x27274ba5bb95306f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265404.723506:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047cf9bb0/0x27274ba5bb95306f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265404.723513:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047cf9bb0/0x27274ba5bb95306f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265404.723524:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265404.723528:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003db7106f/0x27274ba5bb953076 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265404.723534:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad7c00 already unused, calling callback (ffffffffc1581350) 00010000:00010000:0.0:1789265404.723674:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789265404.724551:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:2.0:1789265404.725220:0:14989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037bbf9fc/0x27274ba5bb95307d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.725250:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037bbf9fc/0x27274ba5bb95307d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.725263:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037bbf9fc/0x27274ba5bb95307d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.725271:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000037bbf9fc/0x27274ba5bb95307d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.725294:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789265404.726188:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789265404.726197:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000adc23739/0x27274ba5bb953084 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.726210:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=450s v=(0 0) 00010000:00010000:2.0:1789265404.726215:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265404.726219:0:14989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000adc23739/0x27274ba5bb953084 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.726229:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000adc23739/0x27274ba5bb953084 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.726250:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000adc23739/0x27274ba5bb953084 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.726258:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000adc23739/0x27274ba5bb953084 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.726268:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789265404.726404:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003db7106f/0x27274ba5bb953076 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265404.726456:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003db7106f/0x27274ba5bb953076 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265404.726484:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003db7106f/0x27274ba5bb953076 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265404.726494:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003db7106f/0x27274ba5bb953076 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265404.726576:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789265404.726582:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000037bbf9fc/0x27274ba5bb95307d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265404.726591:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad7a00 already unused, calling callback (ffffffffc1581350) 00010000:00010000:1.0:1789265404.726597:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000037bbf9fc/0x27274ba5bb95307d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265404.726606:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000037bbf9fc/0x27274ba5bb95307d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265404.726619:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000037bbf9fc/0x27274ba5bb95307d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265404.726626:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037bbf9fc/0x27274ba5bb95307d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265404.726663:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265404.726667:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000adc23739/0x27274ba5bb953084 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265404.726675:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad7000 already unused, calling callback (ffffffffc1581350) 00010000:00010000:1.0:1789265404.726679:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000adc23739/0x27274ba5bb953084 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265404.726689:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000adc23739/0x27274ba5bb953084 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265404.726703:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000adc23739/0x27274ba5bb953084 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265404.726710:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000adc23739/0x27274ba5bb953084 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265404.726732:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265404.726734:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265404.726739:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789265404.726760:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789265404.726771:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d404f61/0x27274ba5bb95308b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.726793:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=450s v=(0 0) 00010000:00010000:2.0:1789265404.726796:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265404.726801:0:14989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d404f61/0x27274ba5bb95308b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.726812:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d404f61/0x27274ba5bb95308b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.726822:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d404f61/0x27274ba5bb95308b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.726830:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d404f61/0x27274ba5bb95308b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265404.726981:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265404.727602:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789265404.728307:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789265404.728316:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084b7c927/0x27274ba5bb953092 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.728327:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=450s v=(0 0) 00010000:00010000:2.0:1789265404.728331:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265404.728336:0:14989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084b7c927/0x27274ba5bb953092 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.728346:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084b7c927/0x27274ba5bb953092 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.728353:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084b7c927/0x27274ba5bb953092 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.728359:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000084b7c927/0x27274ba5bb953092 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265404.730686:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789265404.730702:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d404f61/0x27274ba5bb95308b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265404.730715:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad6000 already unused, calling callback (ffffffffc1581350) 00010000:00010000:0.0:1789265404.730719:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d404f61/0x27274ba5bb95308b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265404.730729:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d404f61/0x27274ba5bb95308b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265404.730750:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d404f61/0x27274ba5bb95308b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265404.730776:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d404f61/0x27274ba5bb95308b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265404.731344:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265404.731352:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000084b7c927/0x27274ba5bb953092 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265404.731359:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a102e537800 already unused, calling callback (ffffffffc1581350) 00010000:00010000:3.0:1789265404.731363:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000084b7c927/0x27274ba5bb953092 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265404.731370:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000084b7c927/0x27274ba5bb953092 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265404.731388:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000084b7c927/0x27274ba5bb953092 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265404.731419:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265404.731421:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265404.731424:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265404.731625:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789265404.731633:0:14989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084b7c927/0x27274ba5bb953092 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789265404.732534:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789265404.732543:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000803e4d77/0x27274ba5bb953099 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.732561:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=450s v=(0 0) 00010000:00010000:2.0:1789265404.732566:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265404.732573:0:14989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000803e4d77/0x27274ba5bb953099 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.732586:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000803e4d77/0x27274ba5bb953099 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.732595:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000803e4d77/0x27274ba5bb953099 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.732603:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000803e4d77/0x27274ba5bb953099 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265404.734040:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265404.734054:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000803e4d77/0x27274ba5bb953099 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265404.734066:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a102e536200 already unused, calling callback (ffffffffc1581350) 00010000:00010000:0.0:1789265404.734071:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000803e4d77/0x27274ba5bb953099 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265404.736304:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000803e4d77/0x27274ba5bb953099 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265404.736329:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000803e4d77/0x27274ba5bb953099 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265404.737219:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265404.737227:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265404.737232:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265404.738881:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789265404.738897:0:14989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000803e4d77/0x27274ba5bb953099 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789265404.741305:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789265404.741317:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000764c50b9/0x27274ba5bb9530a0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.741334:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=450s v=(0 0) 00010000:00010000:2.0:1789265404.741339:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265404.741346:0:14989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000764c50b9/0x27274ba5bb9530a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.741374:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000764c50b9/0x27274ba5bb9530a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.741386:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000764c50b9/0x27274ba5bb9530a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.741395:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000764c50b9/0x27274ba5bb9530a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.750061:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789265404.750132:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265404.750149:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000764c50b9/0x27274ba5bb9530a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265404.750195:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a102e537200 already unused, calling callback (ffffffffc1581350) 00010000:00010000:1.0:1789265404.750201:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000764c50b9/0x27274ba5bb9530a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265404.750214:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000764c50b9/0x27274ba5bb9530a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265404.750245:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000764c50b9/0x27274ba5bb9530a0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265404.750253:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000764c50b9/0x27274ba5bb9530a0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265404.750296:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265404.750299:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265404.750302:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789265404.750761:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789265404.750771:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b413a05/0x27274ba5bb9530a7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.750786:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=450s v=(0 0) 00010000:00010000:2.0:1789265404.750790:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265404.750796:0:14989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b413a05/0x27274ba5bb9530a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.750809:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b413a05/0x27274ba5bb9530a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.750818:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b413a05/0x27274ba5bb9530a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.750835:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b413a05/0x27274ba5bb9530a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.750865:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789265404.751469:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789265404.751477:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a8be13a/0x27274ba5bb9530ae lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.751487:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=450s v=(0 0) 00010000:00010000:2.0:1789265404.751491:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265404.751495:0:14989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a8be13a/0x27274ba5bb9530ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.751505:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a8be13a/0x27274ba5bb9530ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.751514:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a8be13a/0x27274ba5bb9530ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.751521:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a8be13a/0x27274ba5bb9530ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.751543:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789265404.752070:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789265404.752097:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b413a05/0x27274ba5bb9530a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265404.752111:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a102e536600 already unused, calling callback (ffffffffc1581350) 00010000:00010000:1.0:1789265404.752117:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b413a05/0x27274ba5bb9530a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265404.752129:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b413a05/0x27274ba5bb9530a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265404.752174:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b413a05/0x27274ba5bb9530a7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265404.752183:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b413a05/0x27274ba5bb9530a7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265404.752209:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265404.752214:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a8be13a/0x27274ba5bb9530ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265404.752220:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a102e537000 already unused, calling callback (ffffffffc1581350) 00010000:00010000:1.0:1789265404.752223:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a8be13a/0x27274ba5bb9530ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265404.752232:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a8be13a/0x27274ba5bb9530ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265404.752242:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a8be13a/0x27274ba5bb9530ae lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265404.752249:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a8be13a/0x27274ba5bb9530ae lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265404.752262:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265404.752264:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265404.752273:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789265404.753143:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789265404.753156:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009164d5b5/0x27274ba5bb9530b5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.753179:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=450s v=(0 0) 00010000:00010000:2.0:1789265404.753183:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265404.753189:0:14989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009164d5b5/0x27274ba5bb9530b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.753202:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009164d5b5/0x27274ba5bb9530b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.753212:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009164d5b5/0x27274ba5bb9530b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.753220:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009164d5b5/0x27274ba5bb9530b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.753246:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789265404.753289:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265404.753301:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009164d5b5/0x27274ba5bb9530b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265404.753312:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a102e537c00 already unused, calling callback (ffffffffc1581350) 00010000:00010000:1.0:1789265404.753318:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009164d5b5/0x27274ba5bb9530b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265404.753328:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009164d5b5/0x27274ba5bb9530b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265404.753349:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009164d5b5/0x27274ba5bb9530b5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265404.753356:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009164d5b5/0x27274ba5bb9530b5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265404.753377:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265404.753378:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265404.753380:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789265404.754527:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789265404.754537:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c402565d/0x27274ba5bb9530bc lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.754550:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=450s v=(0 0) 00010000:00010000:2.0:1789265404.754554:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265404.754559:0:14989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c402565d/0x27274ba5bb9530bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.754571:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c402565d/0x27274ba5bb9530bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.754592:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c402565d/0x27274ba5bb9530bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.754600:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c402565d/0x27274ba5bb9530bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.754625:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789265404.754666:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265404.754680:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c402565d/0x27274ba5bb9530bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265404.754693:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a102e536c00 already unused, calling callback (ffffffffc1581350) 00010000:00010000:1.0:1789265404.754699:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c402565d/0x27274ba5bb9530bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265404.754732:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c402565d/0x27274ba5bb9530bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265404.754755:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c402565d/0x27274ba5bb9530bc lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265404.754764:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c402565d/0x27274ba5bb9530bc lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265404.754797:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265404.754800:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265404.754805:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265404.755273:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265404.755843:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789265404.756541:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789265404.756552:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007270b08/0x27274ba5bb9530c3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.756567:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=450s v=(0 0) 00010000:00010000:2.0:1789265404.756572:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265404.756577:0:14989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007270b08/0x27274ba5bb9530c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.756590:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007270b08/0x27274ba5bb9530c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.756600:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007270b08/0x27274ba5bb9530c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.756607:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007270b08/0x27274ba5bb9530c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.756737:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789265404.757369:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789265404.757377:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001571dcca/0x27274ba5bb9530ca lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.757523:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=450s v=(0 0) 00010000:00010000:2.0:1789265404.757527:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265404.757532:0:14989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001571dcca/0x27274ba5bb9530ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.757543:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001571dcca/0x27274ba5bb9530ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.757551:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001571dcca/0x27274ba5bb9530ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.757559:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001571dcca/0x27274ba5bb9530ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265404.757721:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789265404.757729:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007270b08/0x27274ba5bb9530c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265404.757738:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a102e537400 already unused, calling callback (ffffffffc1581350) 00010000:00010000:3.0:1789265404.757743:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007270b08/0x27274ba5bb9530c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265404.757752:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007270b08/0x27274ba5bb9530c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265404.757771:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007270b08/0x27274ba5bb9530c3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265404.757791:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007270b08/0x27274ba5bb9530c3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.758175:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789265404.758662:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265404.758669:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001571dcca/0x27274ba5bb9530ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265404.758680:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a102e537e00 already unused, calling callback (ffffffffc1581350) 00010000:00010000:3.0:1789265404.758689:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001571dcca/0x27274ba5bb9530ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265404.758699:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001571dcca/0x27274ba5bb9530ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265404.758713:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001571dcca/0x27274ba5bb9530ca lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265404.758721:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001571dcca/0x27274ba5bb9530ca lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265404.758737:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265404.758739:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265404.758740:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789265404.759556:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789265404.759565:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f352426/0x27274ba5bb9530d1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.759578:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=450s v=(0 0) 00010000:00010000:2.0:1789265404.759586:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265404.759592:0:14989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f352426/0x27274ba5bb9530d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.759604:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f352426/0x27274ba5bb9530d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.759613:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f352426/0x27274ba5bb9530d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.759620:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f352426/0x27274ba5bb9530d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.759643:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789265404.760061:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265404.760068:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f352426/0x27274ba5bb9530d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265404.760096:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a102e536400 already unused, calling callback (ffffffffc1581350) 00010000:00010000:3.0:1789265404.760101:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f352426/0x27274ba5bb9530d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265404.760109:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f352426/0x27274ba5bb9530d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265404.760125:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f352426/0x27274ba5bb9530d1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265404.760138:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f352426/0x27274ba5bb9530d1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265404.760154:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265404.760156:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265404.760158:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789265404.760442:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789265404.760449:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053b6ba01/0x27274ba5bb9530d8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.760458:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=450s v=(0 0) 00010000:00010000:2.0:1789265404.760461:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265404.760465:0:14989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053b6ba01/0x27274ba5bb9530d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.760475:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053b6ba01/0x27274ba5bb9530d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.760483:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053b6ba01/0x27274ba5bb9530d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.760495:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053b6ba01/0x27274ba5bb9530d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.760537:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789265404.760893:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789265404.760899:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b171ae5/0x27274ba5bb9530df lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.760908:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=450s v=(0 0) 00010000:00010000:2.0:1789265404.760911:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265404.760915:0:14989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b171ae5/0x27274ba5bb9530df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.760924:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b171ae5/0x27274ba5bb9530df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.760938:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b171ae5/0x27274ba5bb9530df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.760946:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b171ae5/0x27274ba5bb9530df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265404.761818:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789265404.761827:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053b6ba01/0x27274ba5bb9530d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265404.761837:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a102e536a00 already unused, calling callback (ffffffffc1581350) 00010000:00010000:3.0:1789265404.761842:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053b6ba01/0x27274ba5bb9530d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265404.761860:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053b6ba01/0x27274ba5bb9530d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265404.761878:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053b6ba01/0x27274ba5bb9530d8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265404.761886:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053b6ba01/0x27274ba5bb9530d8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265404.761908:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265404.761911:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b171ae5/0x27274ba5bb9530df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265404.761930:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a102e537600 already unused, calling callback (ffffffffc1581350) 00010000:00010000:3.0:1789265404.761933:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b171ae5/0x27274ba5bb9530df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265404.761940:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b171ae5/0x27274ba5bb9530df lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265404.761950:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b171ae5/0x27274ba5bb9530df lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265404.761957:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265404.761959:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265404.761961:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265404.762647:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789265404.762658:0:14989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b171ae5/0x27274ba5bb9530df lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265404.762699:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265404.762708:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265404.762711:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789265404.763584:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789265404.763593:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b1ce3e3/0x27274ba5bb9530e6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.763607:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=450s v=(0 0) 00010000:00010000:2.0:1789265404.763612:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265404.763618:0:14989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b1ce3e3/0x27274ba5bb9530e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.763630:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b1ce3e3/0x27274ba5bb9530e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.763639:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b1ce3e3/0x27274ba5bb9530e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.763646:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b1ce3e3/0x27274ba5bb9530e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.763668:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789265404.763955:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265404.763963:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b1ce3e3/0x27274ba5bb9530e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265404.763972:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a102e536e00 already unused, calling callback (ffffffffc1581350) 00010000:00010000:3.0:1789265404.763977:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b1ce3e3/0x27274ba5bb9530e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265404.763987:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b1ce3e3/0x27274ba5bb9530e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265404.764004:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b1ce3e3/0x27274ba5bb9530e6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265404.764020:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b1ce3e3/0x27274ba5bb9530e6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265404.764040:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265404.764041:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265404.764043:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789265404.764622:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789265404.764629:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ead3b11c/0x27274ba5bb9530ed lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.764639:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=450s v=(0 0) 00010000:00010000:2.0:1789265404.764643:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265404.764655:0:14989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ead3b11c/0x27274ba5bb9530ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.764666:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ead3b11c/0x27274ba5bb9530ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.764676:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ead3b11c/0x27274ba5bb9530ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.764683:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ead3b11c/0x27274ba5bb9530ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.764948:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789265404.766155:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789265404.766167:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067dfed58/0x27274ba5bb9530f4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.766183:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=450s v=(0 0) 00010000:00010000:2.0:1789265404.766189:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265404.766195:0:14989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067dfed58/0x27274ba5bb9530f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.766209:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067dfed58/0x27274ba5bb9530f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.766220:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067dfed58/0x27274ba5bb9530f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.766241:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067dfed58/0x27274ba5bb9530f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265404.766653:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789265404.766661:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ead3b11c/0x27274ba5bb9530ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265404.766669:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a102e536000 already unused, calling callback (ffffffffc1581350) 00010000:00010000:3.0:1789265404.766674:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ead3b11c/0x27274ba5bb9530ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265404.769404:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ead3b11c/0x27274ba5bb9530ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265404.769444:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ead3b11c/0x27274ba5bb9530ed lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265404.769453:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ead3b11c/0x27274ba5bb9530ed lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265404.769485:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265404.769490:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067dfed58/0x27274ba5bb9530f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265404.769504:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a102e537a00 already unused, calling callback (ffffffffc1581350) 00010000:00010000:3.0:1789265404.769508:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067dfed58/0x27274ba5bb9530f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265404.769516:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067dfed58/0x27274ba5bb9530f4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265404.769528:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067dfed58/0x27274ba5bb9530f4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265404.769536:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265404.769538:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265404.769542:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265404.769736:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265404.771288:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789265404.771315:0:14989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067dfed58/0x27274ba5bb9530f4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789265404.774484:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789265404.774499:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000803e4d77/0x27274ba5bb9530fb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.774517:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=450s v=(0 0) 00010000:00010000:2.0:1789265404.774523:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265404.774530:0:14989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000803e4d77/0x27274ba5bb9530fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.774546:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000803e4d77/0x27274ba5bb9530fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.774558:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000803e4d77/0x27274ba5bb9530fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265404.774567:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000803e4d77/0x27274ba5bb9530fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265404.774688:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265404.774695:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000803e4d77/0x27274ba5bb9530fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265404.774704:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a102e536200 already unused, calling callback (ffffffffc1581350) 00010000:00010000:3.0:1789265404.774709:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000803e4d77/0x27274ba5bb9530fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265404.774719:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000803e4d77/0x27274ba5bb9530fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265404.774735:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000803e4d77/0x27274ba5bb9530fb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265404.775189:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265404.775193:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265404.775195:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265404.775351:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789265404.775357:0:14989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000803e4d77/0x27274ba5bb9530fb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1789265404.775749:0:14989:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:2.0:1789265404.775919:0:14989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1016d45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14327:x1876180414328832:12345-0@lo:5:osp-pre-0-0.0 Request processed in 161645us (163791us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265404.775933:0:14989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1789265404.775990:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265404.776036:0:14327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1016d44700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14327:1876180414328832:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1789265404.776053:0:14327:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:0.0:1789265404.776251:0:14327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1016d44700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14327:1876180414328960:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1789265404.776290:0:14327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265404.776341:0:14327:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a102ec33c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789265404.776405:0:14990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414328960 00000100:00100000:3.0:1789265404.776422:0:14990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414328960 00000100:00100000:3.0:1789265404.776472:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789265404.776482:0:14990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1016d44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14327:x1876180414328960:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1789265404.776519:0:14990:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:2.0:1789265404.784651:0:14990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1016d44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14327:x1876180414328960:12345-0@lo:5:osp-pre-0-0.0 Request processed in 8162us (8351us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1789265404.784665:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789265404.784744:0:14327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1016d44700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14327:1876180414328960:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1789265404.784771:0:14327:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:3.0:1789265405.362321:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265406.387172:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265407.410278:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789265407.533154:0:15707:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789265407.533160:0:15707:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1789265407.533419:0:15707:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8a1003113800 00000020:01000004:2.0:1789265407.533438:0:15707:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1789265407.533455:0:15707:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1789265407.533472:0:15707:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8a1008f43370) 00000020:00000080:2.0:1789265407.533491:0:15707:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1789265407.565707:0:15707:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1789265407.566341:0:15707:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1789265407.575471:0:15707:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1789265407.576363:0:15707:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1789265407.577224:0:15707:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1789265407.578346:0:15707:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 403: rc = 0 00100000:10000000:0.0:1789265407.578470:0:15707:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 403: rc = 0 00100000:10000000:0.0:1789265407.578734:0:15707:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 403: rc = 0 00100000:10000000:0.0:1789265407.583322:0:15707:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 896: rc = 0 00100000:10000000:0.0:1789265407.583771:0:15707:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 896: rc = 0 00100000:10000000:0.0:1789265407.587632:0:15707:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 896: rc = 0 00100000:10000000:0.0:1789265407.588207:0:15707:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 896: rc = 0 00100000:10000000:0.0:1789265407.588513:0:15707:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 896: rc = 0 00100000:10000000:0.0:1789265407.588780:0:15707:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 896: rc = 0 00000020:00000080:0.0:1789265407.603169:0:15707:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1789265407.603188:0:15707:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789265407.603206:0:15707:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x27274ba5bb953109 00000020:01000004:0.0:1789265407.603216:0:15707:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1789265407.603245:0:15707:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.137@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789265407.603249:0:15707:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.137@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789265407.603257:0:15707:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1789265407.603289:0:15707:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:0.0:1789265407.603294:0:15707:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.137@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1789265407.619479:0:15707:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.137@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789265407.619531:0:15707:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.137@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1789265407.619536:0:15707:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789265407.619538:0:15707:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789265407.619539:0:15707:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789265407.619541:0:15707:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789265407.619542:0:15707:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789265407.619544:0:15707:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789265407.619546:0:15707:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789265407.619548:0:15707:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789265407.619550:0:15707:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789265407.619554:0:15707:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1789265407.619557:0:15707:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789265407.619558:0:15707:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789265407.619559:0:15707:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789265407.619560:0:15707:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789265407.619561:0:15707:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789265407.619562:0:15707:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789265407.619563:0:15707:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789265407.619564:0:15707:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789265407.619566:0:15707:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789265407.619603:0:15707:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789265407.619630:0:15707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:15707:1876180414329088:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789265407.619747:0:15707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265407.619834:0:15707:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10031cb240 going to sleep for 11 seconds 00000100:00100000:1.0:1789265407.620046:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414329088 00000100:00100000:1.0:1789265407.620057:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414329088 00000100:00100000:1.0:1789265407.620168:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789265407.620179:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102ec4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+16:15707:x1876180414329088:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789265407.620229:0:14298:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1789265407.620232:0:14298:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1789265407.620237:0:14298:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1789265407.635265:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102ec4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+16:15707:x1876180414329088:12345-0@lo:253:mount.lustre.0 Request processed in 15074us (15504us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265407.635285:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789265407.637170:0:15707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:15707:1876180414329088:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789265407.637200:0:15707:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789265407.637204:0:15707:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789265407.637206:0:15707:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789265407.637208:0:15707:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789265407.637209:0:15707:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789265407.637211:0:15707:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789265407.637213:0:15707:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789265407.637215:0:15707:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789265407.637217:0:15707:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789265407.637219:0:15707:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789265407.637262:0:15707:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a1003113800 from lustre-OST0001 10000000:01000000:3.0:1789265407.637298:0:15707:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1789265407.637302:0:15707:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789265407.637313:0:15707:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8a100878b370 local copy 00010000:00010000:3.0:1789265407.637331:0:15707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a103fa35c00/0x27274ba5bb952eaf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb952eb6 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265407.640537:0:15707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02e31c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:15707:1876180414329216:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789265407.642135:0:15707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265407.642258:0:15707:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1007fe7600 going to sleep for 11 seconds 00000100:00100000:0.0:1789265407.642327:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414329216 00000100:00100000:0.0:1789265407.642341:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414329216 00000100:00100000:0.0:1789265407.642463:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789265407.642476:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102ec4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+16:15707:x1876180414329216:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789265407.642894:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102ec4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+16:15707:x1876180414329216:12345-0@lo:501:mount.lustre.0 Request processed in 419us (767us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789265407.642913:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789265407.643188:0:15707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02e31c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:15707:1876180414329216:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789265407.643222:0:15707:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.137@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789265407.643443:0:15707:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.137@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789265407.643457:0:15707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a103fa35c00/0x27274ba5bb952eaf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb952eb6 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265407.643469:0:15707:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff8a103fa35c00/0x27274ba5bb952eaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb952eb6 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265407.643511:0:15707:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8a1003113800 10000000:01000000:3.0:1789265407.643524:0:15707:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789265407.643532:0:15707:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789265407.643535:0:15707:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789265407.643541:0:15707:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1789265407.643546:0:15707:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789265407.643591:0:15707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a103fae8600/0x27274ba5bb953110 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265407.643601:0:15707:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff8a103fae8600/0x27274ba5bb953110 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265407.643612:0:15707:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff8a103fae8600/0x27274ba5bb953110 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265407.643637:0:15707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:15707:1876180414329344:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789265407.643690:0:15707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265407.644719:0:15707:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10031cbd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789265407.646323:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414329344 00000100:00100000:2.0:1789265407.646344:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414329344 00000100:00100000:2.0:1789265407.646446:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789265407.646457:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102ec4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+16:15707:x1876180414329344:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789265407.646480:0:14299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265407.646504:0:14299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a102e536a00/0x27274ba5bb953117 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x27274ba5bb953110 expref: -99 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265407.646540:0:14299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a102e536a00/0x27274ba5bb953117 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27274ba5bb953110 expref: 17 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265407.646552:0:14299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a102e536a00/0x27274ba5bb953117 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb953110 expref: 17 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265407.646562:0:14299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a102e536a00, rc 0) 00000100:00100000:2.0:1789265407.646721:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102ec4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+17:15707:x1876180414329344:12345-0@lo:101:mount.lustre.0 Request processed in 205us (2969us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265407.646730:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789265407.647194:0:15707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:15707:1876180414329344:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789265407.647220:0:15707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff8a103fae8600/0x27274ba5bb953110 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb953117 expref: -99 pid: 15707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265407.647233:0:15707:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff8a103fae8600/0x27274ba5bb953110 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x27274ba5bb953117 expref: -99 pid: 15707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789265407.648652:0:15707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1789265407.650480:0:15707:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789265407.652475:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1789265407.652590:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1789265407.652631:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1789265407.653152:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1789265407.653210:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1789265407.653246:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1789265407.653337:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1789265407.653345:0:15707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1789265407.654513:0:15707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02e33480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:15707:1876180414329472:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789265407.654601:0:15707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265407.654804:0:15707:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103cd509c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265407.655334:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414329472 00000100:00100000:3.0:1789265407.655346:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414329472 00000100:00100000:3.0:1789265407.655436:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789265407.655450:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102ec4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+17:15707:x1876180414329472:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789265407.656353:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102ec4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+17:15707:x1876180414329472:12345-0@lo:501:mount.lustre.0 Request processed in 902us (1747us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265407.656374:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789265407.656588:0:15707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02e33480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:15707:1876180414329472:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789265407.656697:0:15707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02e33480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:15707:1876180414329600:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789265407.656756:0:15707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265407.657157:0:15707:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103cd509c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265407.657225:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414329600 00000100:00100000:1.0:1789265407.657234:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414329600 00000100:00100000:1.0:1789265407.657321:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789265407.657331:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103cabc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+17:15707:x1876180414329600:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789265407.657924:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103cabc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+17:15707:x1876180414329600:12345-0@lo:503:mount.lustre.0 Request processed in 591us (1165us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265407.657933:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789265407.659684:0:15707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02e33480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:15707:1876180414329600:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789265407.660811:0:15707:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789265407.660937:0:15707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:15707:1876180414329728:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789265407.661032:0:15707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265407.661128:0:15707:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10031cb780 going to sleep for 11 seconds 00000100:00100000:2.0:1789265407.661705:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414329728 00000100:00100000:2.0:1789265407.661718:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414329728 00000100:00100000:2.0:1789265407.661789:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789265407.661800:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103cabdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+17:15707:x1876180414329728:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789265407.662178:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103cabdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+17:15707:x1876180414329728:12345-0@lo:502:mount.lustre.0 Request processed in 378us (1144us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265407.662441:0:15707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:15707:1876180414329728:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789265407.662651:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000040:00080000:3.0:1789265407.662750:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1789265407.662923:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1789265407.662953:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1789265407.663522:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1789265407.663580:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1789265407.663618:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1789265407.663664:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1789265407.663706:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1789265407.663747:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1789265407.664041:0:15707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:15707:1876180414329856:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789265407.664165:0:15707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265407.664261:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414329856 00000100:00100000:1.0:1789265407.664271:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414329856 00000100:00100000:1.0:1789265407.664397:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789265407.664410:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103cabd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+17:15707:x1876180414329856:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789265407.664457:0:15707:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10031cb780 going to sleep for 11 seconds 00000100:00100000:1.0:1789265407.664658:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103cabd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+17:15707:x1876180414329856:12345-0@lo:502:mount.lustre.0 Request processed in 251us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265407.664667:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789265407.664693:0:15707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:15707:1876180414329856:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789265407.664794:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1789265407.664806:0:15707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1789265407.667774:0:15708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789265407.667912:0:15708:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1789265407.667922:0:15708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265407.667925:0:15708:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1789265407.667932:0:15708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789265407.667956:0:15708:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8a10037d19b8) 00000020:00000080:1.0:1789265407.668061:0:15708:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789265407.668070:0:15708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789265407.668224:0:15708:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a1003113800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1789265407.668235:0:15708:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789265407.668246:0:15708:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x27274ba5bb953125 00010000:00010000:1.0:1789265407.678563:0:15708:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1789265407.680622:0:15708:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:2.0:1789265407.689404:0:15708:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1789265407.691897:0:15708:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1789265407.691915:0:15708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265407.691923:0:15708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265407.691926:0:15708:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1789265407.691930:0:15708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789265407.691935:0:15708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265407.691936:0:15708:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789265407.691939:0:15708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789265407.691942:0:15708:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789265407.691944:0:15708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265407.691946:0:15708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265407.691948:0:15708:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789265407.691950:0:15708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789265407.691953:0:15708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265407.691955:0:15708:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789265407.691958:0:15708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1789265407.692250:0:15708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265407.692254:0:15708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265407.692256:0:15708:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789265407.692268:0:15708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1789265407.698692:0:15707:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1789265407.698759:0:15707:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789265407.698848:0:15707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a103fae8600/0x27274ba5bb953110 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb953117 expref: -99 pid: 15707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265407.698864:0:15707:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff8a103fae8600/0x27274ba5bb953110 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb953117 expref: -99 pid: 15707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265407.698874:0:15707:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a1003113800 from 1 10000000:01000000:1.0:1789265407.698877:0:15707:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789265407.698929:0:15707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a101b596800/0x27274ba5bb95312c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265407.698939:0:15707:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff8a101b596800/0x27274ba5bb95312c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265407.698953:0:15707:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff8a101b596800/0x27274ba5bb95312c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265407.698997:0:15707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02df6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:15707:1876180414329984:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789265407.699121:0:15707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265407.699180:0:15707:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1011abe840 going to sleep for 11 seconds 00000100:00100000:0.0:1789265407.700532:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414329984 00000100:00100000:0.0:1789265407.700548:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414329984 00000100:00100000:0.0:1789265407.700627:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789265407.700640:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103cabc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+17:15707:x1876180414329984:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789265407.700662:0:14299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265407.700683:0:14299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a103fa35000/0x27274ba5bb953133 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x27274ba5bb95312c expref: -99 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265407.700717:0:14299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a103fa35000/0x27274ba5bb953133 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27274ba5bb95312c expref: 18 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265407.700730:0:14299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a103fa35000/0x27274ba5bb953133 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb95312c expref: 18 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265407.700740:0:14299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fa35000, rc 0) 00000100:00100000:0.0:1789265407.700846:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103cabc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+18:15707:x1876180414329984:12345-0@lo:101:mount.lustre.0 Request processed in 209us (1724us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265407.700854:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789265407.702032:0:15707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02df6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:15707:1876180414329984:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789265407.702065:0:15707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff8a101b596800/0x27274ba5bb95312c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb953133 expref: -99 pid: 15707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265407.702094:0:15707:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff8a101b596800/0x27274ba5bb95312c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x27274ba5bb953133 expref: -99 pid: 15707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789265407.702842:0:15707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1789265407.703451:0:15707:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789265407.703755:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1789265407.703812:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1789265407.703878:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1789265407.703887:0:15707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1789265407.703983:0:15707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02df6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:15707:1876180414330112:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789265407.704072:0:15707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265407.704182:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414330112 00000100:00100000:1.0:1789265407.704191:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414330112 00000100:00100000:1.0:1789265407.704251:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789265407.704262:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103cabe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+18:15707:x1876180414330112:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789265407.704547:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103cabe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+18:15707:x1876180414330112:12345-0@lo:501:mount.lustre.0 Request processed in 285us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265407.704556:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789265407.704611:0:15707:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1011abe840 going to sleep for 11 seconds 00000100:00100000:1.0:1789265407.704638:0:15707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02df6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:15707:1876180414330112:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789265407.704692:0:15707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02df6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:15707:1876180414330240:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789265407.704738:0:15707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265407.704765:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414330240 00000100:00100000:1.0:1789265407.704769:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414330240 00000100:00100000:1.0:1789265407.704794:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789265407.704801:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103cabf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+18:15707:x1876180414330240:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789265407.704952:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103cabf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+18:15707:x1876180414330240:12345-0@lo:503:mount.lustre.0 Request processed in 150us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265407.704959:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789265407.704992:0:15707:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1011abe840 going to sleep for 11 seconds 00000100:00100000:1.0:1789265407.705006:0:15707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02df6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:15707:1876180414330240:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789265407.713573:0:15707:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789265407.713803:0:15707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02df6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:15707:1876180414330368:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789265407.714069:0:15707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265407.714357:0:15707:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1011abe840 going to sleep for 11 seconds 00000100:00100000:2.0:1789265407.714411:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414330368 00000100:00100000:2.0:1789265407.714421:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414330368 00000100:00100000:2.0:1789265407.714503:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789265407.714515:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103d8b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+18:15707:x1876180414330368:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789265407.714859:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103d8b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+18:15707:x1876180414330368:12345-0@lo:502:mount.lustre.0 Request processed in 344us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265407.714868:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789265407.715414:0:15707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02df6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:15707:1876180414330368:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789265407.716424:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1789265407.716514:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1789265407.716563:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1789265407.716937:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1789265407.717165:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1789265407.717233:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1789265407.717272:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1789265407.717307:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1789265407.717379:0:15707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:15707:1876180414330496:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789265407.717503:0:15707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265407.717715:0:15707:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10031cb780 going to sleep for 11 seconds 00000100:00100000:0.0:1789265407.717784:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414330496 00000100:00100000:0.0:1789265407.717794:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414330496 00000100:00100000:0.0:1789265407.718067:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789265407.718108:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103d8b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+18:15707:x1876180414330496:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789265407.718416:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103d8b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+18:15707:x1876180414330496:12345-0@lo:502:mount.lustre.0 Request processed in 311us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265407.718425:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789265407.718532:0:15707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:15707:1876180414330496:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789265407.718689:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1789265407.718703:0:15707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1789265407.721905:0:15712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789265407.721924:0:15712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265407.721926:0:15712:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789265407.721935:0:15712:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a1003113800 00000020:00000080:1.0:1789265407.721938:0:15712:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789265407.721947:0:15712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789265407.721949:0:15712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265407.721951:0:15712:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789265407.721953:0:15712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789265407.721955:0:15712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265407.721957:0:15712:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789265407.721960:0:15712:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a1003113800 00000020:00000080:1.0:1789265407.721962:0:15712:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789265407.722131:0:15712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789265407.722153:0:15712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265407.722154:0:15712:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789265407.722157:0:15712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789265407.722160:0:15712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265407.722161:0:15712:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789265407.722165:0:15712:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a1003113800 00000020:00000080:1.0:1789265407.722167:0:15712:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789265407.722205:0:15712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789265407.722209:0:15712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265407.722210:0:15712:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789265407.722214:0:15712:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1789265407.723104:0:15707:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1789265407.723146:0:15707:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789265407.723170:0:15707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a101b596800/0x27274ba5bb95312c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb953133 expref: -99 pid: 15707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265407.723184:0:15707:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff8a101b596800/0x27274ba5bb95312c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb953133 expref: -99 pid: 15707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265407.723238:0:15707:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789265407.723242:0:15707:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8a1003113800 10000000:01000000:3.0:1789265407.723245:0:15707:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8a1003113800 10000000:01000000:3.0:1789265407.723249:0:15707:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789265407.723257:0:15707:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a1003113800 from 1 10000000:01000000:3.0:1789265407.723259:0:15707:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789265407.723305:0:15707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a103fae9200/0x27274ba5bb95313a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265407.723314:0:15707:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff8a103fae9200/0x27274ba5bb95313a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265407.723348:0:15707:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff8a103fae9200/0x27274ba5bb95313a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265407.723380:0:15707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:15707:1876180414330624:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789265407.723485:0:15707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265407.723537:0:15707:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10031cb780 going to sleep for 11 seconds 00000100:00100000:3.0:1789265407.724918:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414330624 00000100:00100000:3.0:1789265407.724936:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414330624 00000100:00100000:3.0:1789265407.725101:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789265407.725114:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103d8b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+18:15707:x1876180414330624:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789265407.725137:0:14298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265407.725161:0:14298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a103fae9e00/0x27274ba5bb953141 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x27274ba5bb95313a expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265407.725196:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a103fae9e00/0x27274ba5bb953141 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27274ba5bb95313a expref: 19 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265407.725209:0:14298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a103fae9e00/0x27274ba5bb953141 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb95313a expref: 19 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265407.725220:0:14298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fae9e00, rc 0) 00000100:00100000:3.0:1789265407.725311:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103d8b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+19:15707:x1876180414330624:12345-0@lo:101:mount.lustre.0 Request processed in 201us (1827us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265407.725318:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789265407.725403:0:15707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:15707:1876180414330624:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789265407.725423:0:15707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff8a103fae9200/0x27274ba5bb95313a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb953141 expref: -99 pid: 15707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265407.725446:0:15707:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff8a103fae9200/0x27274ba5bb95313a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x27274ba5bb953141 expref: -99 pid: 15707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789265407.729529:0:15707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1789265407.731534:0:15707:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789265407.731915:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1789265407.731965:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1789265407.732000:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1789265407.732046:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1789265407.732123:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1789265407.732175:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1789265407.732211:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1789265407.732244:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1789265407.732291:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1789265407.732325:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1789265407.732358:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1789265407.735221:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1789265407.735363:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1789265407.735418:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1789265407.735470:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1789265407.735530:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1789265407.735584:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1789265407.735652:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1789265407.735692:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1789265407.735728:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1789265407.735781:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1789265407.735818:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1789265407.735866:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1789265407.735918:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1789265407.735956:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1789265407.737308:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1789265407.737435:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1789265407.737475:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1789265407.737512:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1789265407.737634:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:3.0:1789265407.737669:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:3.0:1789265407.737719:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:3.0:1789265407.737750:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:3.0:1789265407.737801:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:3.0:1789265407.738700:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:3.0:1789265407.738798:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:3.0:1789265407.739690:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:3.0:1789265407.740701:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:3.0:1789265407.740721:0:15707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1789265407.741360:0:15707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:15707:1876180414330752:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789265407.741465:0:15707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265407.741575:0:15707:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10031cb780 going to sleep for 11 seconds 00000100:00100000:2.0:1789265407.746666:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414330752 00000100:00100000:2.0:1789265407.746687:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414330752 00000100:00100000:2.0:1789265407.746772:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789265407.746785:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103d8b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+19:15707:x1876180414330752:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789265407.748010:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103d8b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+19:15707:x1876180414330752:12345-0@lo:501:mount.lustre.0 Request processed in 1217us (6534us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265407.748025:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789265407.749399:0:15707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:15707:1876180414330752:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789265407.749480:0:15707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:15707:1876180414330880:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789265407.750437:0:15707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265407.750494:0:15707:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10031cb780 going to sleep for 11 seconds 00000100:00100000:0.0:1789265407.750950:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414330880 00000100:00100000:0.0:1789265407.751046:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414330880 00000100:00100000:0.0:1789265407.751133:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789265407.751144:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103d8b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+19:15707:x1876180414330880:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789265407.751455:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103d8b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+19:15707:x1876180414330880:12345-0@lo:503:mount.lustre.0 Request processed in 312us (1022us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265407.751464:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789265407.753232:0:15707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:15707:1876180414330880:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789265407.755925:0:15707:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789265407.756104:0:15707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:15707:1876180414331008:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789265407.756212:0:15707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265407.756279:0:15707:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10031cb780 going to sleep for 11 seconds 00000100:00100000:2.0:1789265407.756437:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414331008 00000100:00100000:2.0:1789265407.756448:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414331008 00000100:00100000:2.0:1789265407.756503:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789265407.756514:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103d8b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+19:15707:x1876180414331008:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789265407.756822:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103d8b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+19:15707:x1876180414331008:12345-0@lo:502:mount.lustre.0 Request processed in 309us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265407.756831:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789265407.758914:0:15707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:15707:1876180414331008:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789265407.759451:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1789265407.759763:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1789265407.759810:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1789265407.759893:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1789265407.759935:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1789265407.760124:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1789265407.760182:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1789265407.760220:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1789265407.760269:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1789265407.760308:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1789265407.760343:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1789265407.760796:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1789265407.760868:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1789265407.760904:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1789265407.760955:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1789265407.761162:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1789265407.761200:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1789265407.761252:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1789265407.761291:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1789265407.761326:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1789265407.761375:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1789265407.761424:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1789265407.761480:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1789265407.761531:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1789265407.762193:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1789265407.762233:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1789265407.762310:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1789265407.762346:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1789265407.762373:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1789265407.762431:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1789265407.762469:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1789265407.762500:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1789265407.762529:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1789265407.764961:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1789265407.765041:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1789265407.765134:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1789265407.765175:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1789265407.765210:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1789265407.765280:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1789265407.765317:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1789265407.765398:0:15707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:15707:1876180414331136:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789265407.765510:0:15707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265407.765807:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414331136 00000100:00100000:3.0:1789265407.765821:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414331136 00000100:00100000:3.0:1789265407.766024:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789265407.766037:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103b820850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+19:15707:x1876180414331136:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789265407.766369:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103b820850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+19:15707:x1876180414331136:12345-0@lo:502:mount.lustre.0 Request processed in 332us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265407.766378:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789265407.766471:0:15707:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10031cb780 going to sleep for 11 seconds 00000100:00100000:3.0:1789265407.766503:0:15707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:15707:1876180414331136:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789265407.768797:0:15707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1789265407.771223:0:15707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1789265407.788689:0:15717:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789265407.788715:0:15717:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8a10037d4d28) 00000020:00000080:1.0:1789265407.788747:0:15717:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1789265407.793528:0:15717:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a1003113800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789265407.793543:0:15717:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a1003113800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789265407.793548:0:15717:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a1003113800 3 00010000:00080000:2.0:1789265407.793600:0:15717:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a103f9ae800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.137@tcp at head 00010000:00010000:2.0:1789265407.828624:0:15717:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1789265407.828919:0:15717:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1789265407.830964:0:15717:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789265407.834381:0:15717:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x27274ba5bb95314f 00000100:00080000:2.0:1789265407.834408:0:15717:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789265407.834417:0:15717:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a103f9ae800 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:2.0:1789265407.834473:0:15717:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a0f02e32d80 x1876180414331264/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789265407.834511:0:15717:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789265407.834586:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789265407.834591:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789265407.834593:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a10202a9000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789265407.834599:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 450 00000100:00080000:2.0:1789265407.834603:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1789265407.834609:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a10202a9000 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:2.0:1789265407.834626:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a0f02e30a80 x1876180414331520/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789265407.834688:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02e33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414331392:0@lo:400:kworker.0 00000100:00100000:2.0:1789265407.834781:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265407.834865:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02e31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876180414331648:0@lo:400:kworker.0 00000100:00100000:2.0:1789265407.834900:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265407.834922:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789265407.834927:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02e31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1876180414331776:0@lo:400:kworker.0 00000100:00100000:2.0:1789265407.834950:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265407.835070:0:14989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414331392 00000100:00100000:2.0:1789265407.835103:0:14989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414331392 00000100:00100000:2.0:1789265407.835179:0:14989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789265407.835206:0:14989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02e32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3316:x1876180414331392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265407.835270:0:14989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02e32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3316:x1876180414331392:12345-0@lo:400:kworker.0 Request processed in 66us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265407.835277:0:14989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789265407.835305:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414331648 00000100:00100000:2.0:1789265407.835309:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414331648 00000100:00100000:2.0:1789265407.835340:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414331776 00000100:00100000:2.0:1789265407.835343:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414331776 00000100:00100000:2.0:1789265407.835362:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789265407.835368:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02e33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876180414331648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265407.835420:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02e33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876180414331648:12345-0@lo:400:kworker.0 Request processed in 52us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265407.835428:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789265407.835441:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789265407.835447:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02e31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876180414331776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265407.835475:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02e31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876180414331776:12345-0@lo:400:kworker.0 Request processed in 29us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265407.835482:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1789265407.835505:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789265407.835511:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789265407.835554:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a0f02e31500 x1876180414331776/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265407.835572:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02e31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1876180414331776:0@lo:400:kworker.0 00010000:00080000:2.0:1789265407.835584:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a0f02e31f80 x1876180414331648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265407.835593:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02e31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876180414331648:0@lo:400:kworker.0 00000100:00100000:2.0:1789265407.835645:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02e33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414331392:0@lo:400:kworker.0 00000100:00100000:3.0:1789265407.841608:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02e32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3314:1876180414331264:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789265407.841718:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265407.841781:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02e30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1876180414331520:0@lo:8:kworker.0 00000100:00100000:3.0:1789265407.841813:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265407.841942:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414331264 00000100:00100000:3.0:1789265407.841952:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414331264 00000100:00100000:3.0:1789265407.842128:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789265407.842138:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3314:x1876180414331264:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789265407.842190:0:14304:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 453 last 0 00000020:00000080:3.0:1789265407.842243:0:14304:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x27274ba5bb953156 00000004:00100000:3.0:1789265407.842266:0:14304:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789265407.842311:0:14304:0:(import.c:65:import_set_state_nolock()) ffff8a100901c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789265407.842382:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876180414331264:12345-0@lo:38:llog_process_th.0 Request processed in 243us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265407.842403:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789265407.842435:0:14990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414331520 00000100:00100000:3.0:1789265407.842440:0:14990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414331520 00000100:00100000:3.0:1789265407.842465:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789265407.842470:0:14990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3314:x1876180414331520:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1789265407.842511:0:14990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3314:x1876180414331520:12345-0@lo:8:kworker.0 Request processed in 39us (696us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789265407.842517:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789265407.842556:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a0f02e32d80 x1876180414331264/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789265417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265407.842570:0:3314:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789265407.842580:0:3314:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1789265407.842590:0:3314:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789265407.842595:0:3314:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789265407.842598:0:3314:0:(import.c:65:import_set_state_nolock()) ffff8a103f9ae800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789265407.842604:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02e32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3314:1876180414331264:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789265407.842615:0:3314:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789265407.842619:0:3314:0:(import.c:65:import_set_state_nolock()) ffff8a10202a9000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789265407.842622:0:3314:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789265407.842634:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02e30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1876180414331520:0@lo:8:kworker.0 00000040:00080000:2.0:1789265407.846273:0:15717:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1789265407.857233:0:15707:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1789265407.857282:0:15707:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789265407.857309:0:15707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a103fae9200/0x27274ba5bb95313a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb953141 expref: -99 pid: 15707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265407.857323:0:15707:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff8a103fae9200/0x27274ba5bb95313a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb953141 expref: -99 pid: 15707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789265407.857400:0:15707:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789265407.857403:0:15707:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789265407.857404:0:15707:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789265407.857405:0:15707:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789265407.857407:0:15707:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789265407.857409:0:15707:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789265407.857411:0:15707:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789265407.857413:0:15707:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789265407.857415:0:15707:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789265407.857420:0:15707:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1789265407.857423:0:15707:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789265407.857424:0:15707:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789265407.857425:0:15707:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789265407.857427:0:15707:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789265407.857428:0:15707:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789265407.857429:0:15707:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789265407.857430:0:15707:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789265407.857431:0:15707:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789265407.857432:0:15707:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789265407.857466:0:15707:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789265407.857499:0:15707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1016d45880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:15707:1876180414331904:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789265407.857601:0:15707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265407.857657:0:15707:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1006207300 going to sleep for 11 seconds 00000100:00100000:3.0:1789265407.864247:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414331904 00000100:00100000:3.0:1789265407.864269:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414331904 00000100:00100000:3.0:1789265407.864334:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789265407.864345:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103b821050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+19:15707:x1876180414331904:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789265407.864398:0:14297:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1789265407.864417:0:14297:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789265407.929594:0:14297:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789265407.929614:0:14297:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1789265407.929658:0:14320:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789265407.929663:0:14320:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789265407.929691:0:14320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a103fa34200/0x27274ba5bb95315d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265407.929714:0:14320:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a103fae8800/0x27274ba5bb953030 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb953029 expref: 19 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265407.929723:0:14320:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a103fa34200/0x27274ba5bb95315d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265407.929776:0:14320:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a103fae8800/0x27274ba5bb953030 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27274ba5bb953029 expref: 19 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265407.929794:0:14320:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a103fae8800/0x27274ba5bb953030 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27274ba5bb953029 expref: 19 pid: 14299 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265407.929811:0:14320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1016d47480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14320:1876180414332032:0@lo:104: 00000100:00100000:0.0:1789265407.930749:0:14320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265407.930818:0:14320:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1037ebd780 going to sleep for 11 seconds 00000100:00100000:2.0:1789265407.930992:0:14287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414332032 00000100:00100000:2.0:1789265407.931003:0:14287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414332032 00000100:00100000:2.0:1789265407.931152:0:14287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789265407.931164:0:14287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1016d44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+3:14320:x1876180414332032:12345-0@lo:104: 00010000:00010000:2.0:1789265407.931182:0:14287:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff8a103fa34e00/0x27274ba5bb953029 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27274ba5bb953030 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265407.931260:0:14287:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789265407.931266:0:14287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1016d44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+3:14320:x1876180414332032:12345-0@lo:104: Request processed in 106us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265407.931274:0:14287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789265407.931652:0:14320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1016d47480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14320:1876180414332032:0@lo:104: 00010000:00010000:0.0:1789265407.931680:0:14320:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a103fa34200/0x27274ba5bb95315d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265407.932312:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265407.932322:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff8a103fa34e00/0x27274ba5bb953029 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27274ba5bb953030 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265407.932332:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fa34e00 already unused, calling callback (ffffffffc1ba2c20) 10000000:00010000:2.0:1789265407.932337:0:14292:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff8a103fa34e00/0x27274ba5bb953029 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x27274ba5bb953030 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265407.932348:0:14292:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff8a103fa34e00/0x27274ba5bb953029 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x27274ba5bb953030 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265407.932356:0:14292:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff8a103fa34e00/0x27274ba5bb953029 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x27274ba5bb953030 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265407.932362:0:14292:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789265407.932435:0:14292:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff8a103fa34e00/0x27274ba5bb953029 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb953030 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265407.932442:0:14292:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265407.932468:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff8a103fa34e00/0x27274ba5bb953029 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb953030 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265407.932476:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff8a103fa34e00/0x27274ba5bb953029 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb953030 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265407.932496:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265407.932498:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265407.932500:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265407.932525:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02e33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:3315:1876180414332160:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789265407.932598:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265407.934325:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414332160 00000100:00100000:1.0:1789265407.934357:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414332160 00010000:00010000:1.0:1789265407.934419:0:14289:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a103fae8800/0x27274ba5bb953030 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27274ba5bb953029 expref: 20 pid: 14299 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265407.934464:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789265407.934475:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02e31f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+20:3315:x1876180414332160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789265407.934493:0:14289:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265407.934499:0:14289:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a103fae8800/0x27274ba5bb953030 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27274ba5bb953029 expref: 20 pid: 14299 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265407.934516:0:14289:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a103fae8800/0x27274ba5bb953030 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27274ba5bb953029 expref: 20 pid: 14299 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265407.934538:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a103fae8800/0x27274ba5bb953030 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27274ba5bb953029 expref: 20 pid: 14299 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265407.934560:0:14289:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a103fa34200/0x27274ba5bb95315d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265407.934572:0:14289:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a103fa34200/0x27274ba5bb95315d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789265407.934592:0:14289:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004929824s 00010000:00010000:1.0:1789265407.934598:0:14289:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a103fa34200/0x27274ba5bb95315d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265407.934605:0:14289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a103fa34200/0x27274ba5bb95315d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265407.934613:0:14289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a103fa34200/0x27274ba5bb95315d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265407.934631:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a103fa34200/0x27274ba5bb95315d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265407.934637:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fa34200 already unused, calling callback (ffffffffc1581350) 00010000:00010000:1.0:1789265407.934642:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a103fa34200/0x27274ba5bb95315d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265407.934651:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a103fa34200/0x27274ba5bb95315d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265407.934665:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a103fa34200/0x27274ba5bb95315d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265407.934676:0:14289:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265407.934764:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02e31f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+19:3315:x1876180414332160:12345-0@lo:103:ldlm_bl.0 Request processed in 291us (2165us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265407.934772:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789265407.934841:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02e33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:3315:1876180414332160:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789265407.935747:0:14320:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a103fa34200/0x27274ba5bb95315d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265407.935777:0:14320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a103fa34200/0x27274ba5bb95315d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265407.935784:0:14320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a103fa34200/0x27274ba5bb95315d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265407.942789:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103b821050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+18:15707:x1876180414331904:12345-0@lo:253:mount.lustre.0 Request processed in 78429us (85170us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265407.942810:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789265407.942943:0:15707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1016d45880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:15707:1876180414331904:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789265407.942963:0:15707:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789265407.942979:0:15707:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789265407.942981:0:15707:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789265407.942982:0:15707:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789265407.942984:0:15707:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789265407.942985:0:15707:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789265407.942987:0:15707:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789265407.942989:0:15707:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789265407.942991:0:15707:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789265407.942993:0:15707:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789265407.943013:0:15707:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789265407.949641:0:15707:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1789265407.950473:0:15707:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789265407.950681:0:15707:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00000001:00100000:3.0:1789265407.950947:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1789265407.951027:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00080000:10000000:1.0:1789265407.951412:0:15707:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789265407.951624:0:15707:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1789265407.952371:0:15707:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1789265407.953486:0:15707:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1789265408.010384:0:15707:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1789265408.010407:0:15707:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1789265408.010452:0:15707:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789265408.010535:0:15707:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.137@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789265408.010551:0:15707:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1789265408.010587:0:15707:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1789265408.439592:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265409.467681:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265409.842452:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1016d45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414332288:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789265409.842549:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265409.842680:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414332288 00000100:00100000:0.0:1789265409.842691:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414332288 00000100:00100000:0.0:1789265409.842771:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789265409.842782:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02df5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414332288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789265409.842828:0:14991:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789265409.842893:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02df5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414332288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265409.842900:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1789265409.843035:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265409.843104:0:3316:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1789265409.843131:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1016d45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414332288:0@lo:13:osp-pre-0-0.0 10000000:01000000:0.0:1789265409.906662:0:14301:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789265409.906671:0:14301:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a102eccb800 from 8 10000000:01000000:0.0:1789265409.906677:0:14301:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789265409.906740:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a103fa34400/0x27274ba5bb953164 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265409.906773:0:14301:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff8a103fa34400/0x27274ba5bb953164 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265409.906788:0:14301:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff8a103fa34400/0x27274ba5bb953164 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265409.906820:0:14301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1016d47480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14301:1876180414332416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789265409.906913:0:14301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265409.906987:0:14301:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1008ff5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789265409.907226:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414332416 00000100:00100000:3.0:1789265409.907238:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414332416 00000100:00100000:3.0:1789265409.907308:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789265409.907320:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103b823450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+18:14301:x1876180414332416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265409.907337:0:14298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265409.907356:0:14298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a103fae8a00/0x27274ba5bb95316b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27274ba5bb953164 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265409.907397:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a103fae8a00/0x27274ba5bb95316b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27274ba5bb953164 expref: 19 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265409.907410:0:14298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a103fae8a00/0x27274ba5bb95316b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb953164 expref: 19 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265409.907436:0:14298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fae8a00, rc 0) 00000100:00100000:3.0:1789265409.907500:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103b823450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+19:14301:x1876180414332416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 183us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265409.907508:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789265409.907628:0:14301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1016d47480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14301:1876180414332416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789265409.907647:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff8a103fa34400/0x27274ba5bb953164 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb95316b expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.907657:0:14301:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff8a103fa34400/0x27274ba5bb953164 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27274ba5bb95316b expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265409.907722:0:14301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02e31500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14301:1876180414332544:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789265409.907761:0:14301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265409.907791:0:14301:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1018bce6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265409.907937:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414332544 00000100:00100000:3.0:1789265409.907943:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414332544 00000100:00100000:3.0:1789265409.907982:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789265409.907990:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103b820450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+19:14301:x1876180414332544:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789265409.908007:0:14297:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789265409.908027:0:14297:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789265409.908031:0:14297:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1789265409.908157:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103b820450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+19:14301:x1876180414332544:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 167us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265409.908166:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789265409.908202:0:14301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02e31500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14301:1876180414332544:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789265409.908282:0:14301:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789265409.908290:0:14301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a103fa34400/0x27274ba5bb953164 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb95316b expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265409.908300:0:14301:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff8a103fa34400/0x27274ba5bb953164 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb95316b expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265410.483722:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265411.506186:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789265411.891244:0:14336:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789265412.530352:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789265412.916504:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789265412.916513:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789265412.916518:0:37:0:(import.c:65:import_set_state_nolock()) ffff8a10202a9000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789265412.916536:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a10202a9000 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:2.0:1789265412.916566:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a0f02e31500 x1876180414332928/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789265412.916664:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02e31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:3317:1876180414332672:0@lo:400:kworker.0 00000100:00100000:2.0:1789265412.916758:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265412.916816:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02e32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1876180414333312:0@lo:400:kworker.0 00000100:00100000:2.0:1789265412.916852:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265412.916883:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789265412.916888:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02e32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414332800:0@lo:400:kworker.0 00000100:00100000:2.0:1789265412.916914:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265412.916953:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414333312 00000100:00100000:2.0:1789265412.916963:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414333312 00000100:00100000:2.0:1789265412.917025:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789265412.917036:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102eecfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1876180414333312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265412.917240:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02e31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1876180414332928:0@lo:8:kworker.0 00000100:00100000:3.0:1789265412.917363:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02e33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876180414333056:0@lo:400:kworker.0 00000100:00080000:0.0:1789265412.918562:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265412.918588:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02e30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1876180414333184:0@lo:400:kworker.0 00000100:00100000:1.0:1789265412.921352:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265412.923261:0:14990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414332800 00000100:00100000:1.0:1789265412.923279:0:14990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414332800 00000100:00100000:1.0:1789265412.923380:0:14990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414332928 00000100:00100000:1.0:1789265412.923383:0:14990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414332928 00000100:00100000:1.0:1789265412.923404:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789265412.923415:0:14990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102eecf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1876180414332800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265412.923530:0:14990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102eecf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1876180414332800:12345-0@lo:400:kworker.0 Request processed in 117us (6615us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265412.923538:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789265412.923556:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789265412.923561:0:14990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02df7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3314:x1876180414332928:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789265412.923592:0:14990:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 458 last 0 00000020:00000080:1.0:1789265412.923628:0:14990:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x27274ba5bb953172 00002000:00100000:1.0:1789265412.923645:0:14990:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8a10052c9000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113969 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1789265412.923651:0:14990:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1789265412.923654:0:14990:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789265412.924069:0:14990:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789265412.924408:0:14990:0:(import.c:65:import_set_state_nolock()) ffff8a10052c8000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789265412.924490:0:14990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02df7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3314:x1876180414332928:12345-0@lo:8:kworker.0 Request processed in 926us (3147us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265412.924500:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1789265412.924546:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265412.924618:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02e32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414332800:0@lo:400:kworker.0 00010000:00080000:1.0:1789265412.924665:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a0f02e31500 x1876180414332928/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789265437 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789265412.924679:0:3314:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789265412.924689:0:3314:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789265412.924695:0:3314:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1789265412.924698:0:3314:0:(import.c:65:import_set_state_nolock()) ffff8a10202a9000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789265412.924725:0:3314:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789265412.924731:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02e31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1876180414332928:0@lo:8:kworker.0 00000004:00080000:1.0:1789265412.924792:0:14329:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:1.0:1789265412.924816:0:14329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02df6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14329:1876180414333568:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1789265412.924858:0:14329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265412.924883:0:14329:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1010557b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789265412.924897:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02df6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414333440:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789265412.924926:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265412.924963:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414333440 00000100:00100000:1.0:1789265412.924970:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414333440 00000100:00100000:1.0:1789265412.925014:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789265412.925022:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02df4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1876180414333440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789265412.925054:0:14991:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789265412.925284:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265412.925336:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414332672 00000100:00100000:3.0:1789265412.925363:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414332672 00000100:00100000:3.0:1789265412.925400:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789265412.925408:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103b823850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+19:3317:x1876180414332672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265412.925447:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103b823850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+19:3317:x1876180414332672:12345-0@lo:400:kworker.0 Request processed in 40us (8688us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265412.925454:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789265412.925490:0:14304:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789265412.925498:0:14304:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1789265412.925513:0:14306:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789265412.925524:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414333056 00000100:00100000:3.0:1789265412.925528:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414333056 00000100:00100000:3.0:1789265412.925546:0:14306:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789265412.925552:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789265412.925558:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876180414333056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265412.925597:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876180414333056:12345-0@lo:400:kworker.0 Request processed in 39us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265412.925605:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1789265412.925743:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a0f02e33800 x1876180414333056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265412.925757:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02e33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876180414333056:0@lo:400:kworker.0 00000100:00100000:3.0:1789265412.926189:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414333568 00000100:00100000:3.0:1789265412.926195:0:14987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414333568 00000100:00100000:3.0:1789265412.926225:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789265412.926232:0:14987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02df4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14329:x1876180414333568:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1789265412.929387:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02df4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3318:x1876180414333440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4353us (4448us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265412.929421:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1789265412.929582:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789265412.929631:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a0f02df6300 x1876180414333440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265428 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265412.929662:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02df6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414333440:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789265412.929751:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02e31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:3317:1876180414332672:0@lo:400:kworker.0 00000100:00100000:2.0:1789265412.930445:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102eecfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1876180414333312:12345-0@lo:400:kworker.0 Request processed in 13406us (13586us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265412.930459:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00002000:00080000:3.0:1789265412.933021:0:14987:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1789265412.933036:0:14987:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1789265412.933042:0:14987:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00000004:00080000:2.0:1789265412.934064:0:14328:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00010000:00080000:1.0:1789265412.935345:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a0f02e32d80 x1876180414333312/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265412.935382:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02e32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1876180414333312:0@lo:400:kworker.0 00000100:00100000:0.0:1789265412.935551:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265412.936239:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414333184 00000100:00100000:1.0:1789265412.936249:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414333184 00000100:00100000:1.0:1789265412.936327:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789265412.936340:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1016d45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1876180414333184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265412.936440:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1016d45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1876180414333184:12345-0@lo:400:kworker.0 Request processed in 102us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265412.936448:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1789265412.936475:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789265412.939040:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a0f02e30a80 x1876180414333184/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265412.939064:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02e30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1876180414333184:0@lo:400:kworker.0 00000004:00080000:2.0:1789265412.939670:0:14328:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 458744592838ns, next at 0ns, rc = 0 00002000:00010000:3.0:1789265412.958418:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789265412.958432:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d6c7e30/0x27274ba5bb953179 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.958454:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=458s v=(0 0) 00010000:00010000:3.0:1789265412.958460:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265412.958467:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d6c7e30/0x27274ba5bb953179 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.958489:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d6c7e30/0x27274ba5bb953179 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.958502:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d6c7e30/0x27274ba5bb953179 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.958511:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004d6c7e30/0x27274ba5bb953179 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.958541:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789265412.958561:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265412.958568:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004d6c7e30/0x27274ba5bb953179 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.958578:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fae9800 already unused, calling callback (ffffffffc1581350) 00010000:00010000:3.0:1789265412.958584:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004d6c7e30/0x27274ba5bb953179 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.958607:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004d6c7e30/0x27274ba5bb953179 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.958628:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004d6c7e30/0x27274ba5bb953179 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.958637:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d6c7e30/0x27274ba5bb953179 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.958658:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265412.958660:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265412.958662:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789265412.959179:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789265412.959186:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c55b5878/0x27274ba5bb953180 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.959196:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=458s v=(0 0) 00010000:00010000:3.0:1789265412.959200:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265412.959205:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c55b5878/0x27274ba5bb953180 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.959216:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c55b5878/0x27274ba5bb953180 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.959225:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c55b5878/0x27274ba5bb953180 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.959239:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c55b5878/0x27274ba5bb953180 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.959257:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789265412.959269:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265412.959274:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c55b5878/0x27274ba5bb953180 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.959282:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fae8e00 already unused, calling callback (ffffffffc1581350) 00010000:00010000:3.0:1789265412.959286:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c55b5878/0x27274ba5bb953180 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.959294:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c55b5878/0x27274ba5bb953180 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.959306:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c55b5878/0x27274ba5bb953180 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.959314:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c55b5878/0x27274ba5bb953180 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.959328:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265412.959330:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265412.959332:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789265412.959746:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789265412.959760:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ecc08219/0x27274ba5bb953187 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.959769:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=458s v=(0 0) 00010000:00010000:3.0:1789265412.959773:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265412.959778:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ecc08219/0x27274ba5bb953187 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.959788:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ecc08219/0x27274ba5bb953187 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.959798:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ecc08219/0x27274ba5bb953187 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.959805:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ecc08219/0x27274ba5bb953187 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.959821:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789265412.959831:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265412.959835:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ecc08219/0x27274ba5bb953187 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.959843:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fae9400 already unused, calling callback (ffffffffc1581350) 00010000:00010000:3.0:1789265412.959847:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ecc08219/0x27274ba5bb953187 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.959856:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ecc08219/0x27274ba5bb953187 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.959875:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ecc08219/0x27274ba5bb953187 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.959883:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ecc08219/0x27274ba5bb953187 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.959897:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265412.959899:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265412.959901:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789265412.960341:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789265412.960347:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000052e4239/0x27274ba5bb95318e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.960488:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=458s v=(0 0) 00010000:00010000:3.0:1789265412.960492:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265412.960496:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000052e4239/0x27274ba5bb95318e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.960508:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000052e4239/0x27274ba5bb95318e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.960516:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000052e4239/0x27274ba5bb95318e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.960524:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000052e4239/0x27274ba5bb95318e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.960552:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789265412.960565:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265412.960569:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000052e4239/0x27274ba5bb95318e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.960575:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fae8c00 already unused, calling callback (ffffffffc1581350) 00010000:00010000:3.0:1789265412.960579:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000052e4239/0x27274ba5bb95318e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.960586:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000052e4239/0x27274ba5bb95318e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.960598:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000052e4239/0x27274ba5bb95318e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.960605:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000052e4239/0x27274ba5bb95318e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.960619:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265412.960620:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265412.960622:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789265412.962809:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789265412.962834:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ad405c4/0x27274ba5bb953195 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.962856:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=458s v=(0 0) 00010000:00010000:3.0:1789265412.962868:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265412.962875:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ad405c4/0x27274ba5bb953195 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.962892:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ad405c4/0x27274ba5bb953195 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.962905:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ad405c4/0x27274ba5bb953195 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.962914:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009ad405c4/0x27274ba5bb953195 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.962933:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789265412.962948:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265412.962955:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009ad405c4/0x27274ba5bb953195 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.962964:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fae8200 already unused, calling callback (ffffffffc1581350) 00010000:00010000:3.0:1789265412.962969:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009ad405c4/0x27274ba5bb953195 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.962979:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009ad405c4/0x27274ba5bb953195 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.963000:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009ad405c4/0x27274ba5bb953195 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.963018:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ad405c4/0x27274ba5bb953195 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.963043:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265412.963045:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265412.963047:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789265412.964685:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789265412.964700:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099905208/0x27274ba5bb95319c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.964719:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=458s v=(0 0) 00010000:00010000:3.0:1789265412.964724:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265412.964731:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099905208/0x27274ba5bb95319c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.964747:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099905208/0x27274ba5bb95319c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.964759:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099905208/0x27274ba5bb95319c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.964766:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000099905208/0x27274ba5bb95319c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.964902:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789265412.965930:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789265412.965948:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005fcb724a/0x27274ba5bb9531a3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.965970:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=458s v=(0 0) 00010000:00010000:3.0:1789265412.965975:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265412.965980:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005fcb724a/0x27274ba5bb9531a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.965993:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005fcb724a/0x27274ba5bb9531a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.966004:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005fcb724a/0x27274ba5bb9531a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.966012:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005fcb724a/0x27274ba5bb9531a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265412.969415:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789265412.969436:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000099905208/0x27274ba5bb95319c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265412.969454:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fae8800 already unused, calling callback (ffffffffc1581350) 00010000:00010000:0.0:1789265412.969459:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000099905208/0x27274ba5bb95319c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265412.969471:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000099905208/0x27274ba5bb95319c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265412.969517:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000099905208/0x27274ba5bb95319c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265412.969525:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099905208/0x27274ba5bb95319c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265412.969784:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265412.969790:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005fcb724a/0x27274ba5bb9531a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265412.969798:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1042045800 already unused, calling callback (ffffffffc1581350) 00010000:00010000:0.0:1789265412.969802:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005fcb724a/0x27274ba5bb9531a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265412.969810:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005fcb724a/0x27274ba5bb9531a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265412.969821:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005fcb724a/0x27274ba5bb9531a3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265412.969830:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265412.969832:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265412.969834:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265412.975590:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789265412.975613:0:14987:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005fcb724a/0x27274ba5bb9531a3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.975687:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789265412.976598:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789265412.976609:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000972db08d/0x27274ba5bb9531aa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.976628:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=458s v=(0 0) 00010000:00010000:3.0:1789265412.976641:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265412.976648:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000972db08d/0x27274ba5bb9531aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.976665:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000972db08d/0x27274ba5bb9531aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.976677:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000972db08d/0x27274ba5bb9531aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.976684:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000972db08d/0x27274ba5bb9531aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.976713:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789265412.976732:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265412.976739:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000972db08d/0x27274ba5bb9531aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.976748:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1042044800 already unused, calling callback (ffffffffc1581350) 00010000:00010000:3.0:1789265412.976753:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000972db08d/0x27274ba5bb9531aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.976763:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000972db08d/0x27274ba5bb9531aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.976782:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000972db08d/0x27274ba5bb9531aa lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.976803:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000972db08d/0x27274ba5bb9531aa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.976826:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265412.976828:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265412.976830:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789265412.977408:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789265412.977416:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fbf3ce4d/0x27274ba5bb9531b1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.977425:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=458s v=(0 0) 00010000:00010000:3.0:1789265412.977429:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265412.977433:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fbf3ce4d/0x27274ba5bb9531b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.977444:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fbf3ce4d/0x27274ba5bb9531b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.977452:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fbf3ce4d/0x27274ba5bb9531b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.977458:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fbf3ce4d/0x27274ba5bb9531b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.977476:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789265412.977487:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265412.977500:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fbf3ce4d/0x27274ba5bb9531b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.977507:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1042044600 already unused, calling callback (ffffffffc1581350) 00010000:00010000:3.0:1789265412.977511:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fbf3ce4d/0x27274ba5bb9531b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.977518:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fbf3ce4d/0x27274ba5bb9531b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.977532:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fbf3ce4d/0x27274ba5bb9531b1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.977538:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fbf3ce4d/0x27274ba5bb9531b1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.977555:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265412.977558:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265412.977561:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789265412.978057:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789265412.978065:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8fedfe5/0x27274ba5bb9531b8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.978109:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=458s v=(0 0) 00010000:00010000:3.0:1789265412.978113:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265412.978119:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8fedfe5/0x27274ba5bb9531b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.978141:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e8fedfe5/0x27274ba5bb9531b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.978151:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8fedfe5/0x27274ba5bb9531b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.978159:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e8fedfe5/0x27274ba5bb9531b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.978178:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789265412.978190:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265412.978195:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e8fedfe5/0x27274ba5bb9531b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.978202:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1042045a00 already unused, calling callback (ffffffffc1581350) 00010000:00010000:3.0:1789265412.978205:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8fedfe5/0x27274ba5bb9531b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.978213:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8fedfe5/0x27274ba5bb9531b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.978225:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e8fedfe5/0x27274ba5bb9531b8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.978232:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e8fedfe5/0x27274ba5bb9531b8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.978256:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265412.978258:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265412.978260:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789265412.981566:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789265412.981583:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d5d7289/0x27274ba5bb9531bf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.981603:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=458s v=(0 0) 00010000:00010000:3.0:1789265412.981608:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265412.981616:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d5d7289/0x27274ba5bb9531bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.981632:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d5d7289/0x27274ba5bb9531bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.981644:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d5d7289/0x27274ba5bb9531bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.981652:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002d5d7289/0x27274ba5bb9531bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.981682:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789265412.982388:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789265412.982397:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000066f731e/0x27274ba5bb9531c6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.982421:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=458s v=(0 0) 00010000:00010000:3.0:1789265412.982425:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265412.982430:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000066f731e/0x27274ba5bb9531c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.982442:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000066f731e/0x27274ba5bb9531c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.982451:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000066f731e/0x27274ba5bb9531c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.982459:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000066f731e/0x27274ba5bb9531c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.982482:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789265412.982501:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789265412.982508:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002d5d7289/0x27274ba5bb9531bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.982516:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1042045200 already unused, calling callback (ffffffffc1581350) 00010000:00010000:3.0:1789265412.982521:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002d5d7289/0x27274ba5bb9531bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.982532:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002d5d7289/0x27274ba5bb9531bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.982565:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002d5d7289/0x27274ba5bb9531bf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.982574:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d5d7289/0x27274ba5bb9531bf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.982601:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265412.982605:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000066f731e/0x27274ba5bb9531c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.982611:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1042044000 already unused, calling callback (ffffffffc1581350) 00010000:00010000:3.0:1789265412.982615:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000066f731e/0x27274ba5bb9531c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.982624:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000066f731e/0x27274ba5bb9531c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.982633:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000066f731e/0x27274ba5bb9531c6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.982642:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000066f731e/0x27274ba5bb9531c6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.982657:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265412.982659:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265412.982667:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265412.983949:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789265412.985069:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789265412.986562:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019e4767a/0x27274ba5bb9531cd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.986588:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=458s v=(0 0) 00010000:00010000:3.0:1789265412.986594:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265412.986604:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019e4767a/0x27274ba5bb9531cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.986624:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019e4767a/0x27274ba5bb9531cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.986637:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019e4767a/0x27274ba5bb9531cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.986644:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000019e4767a/0x27274ba5bb9531cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.986670:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789265412.986689:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265412.986697:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000019e4767a/0x27274ba5bb9531cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.986706:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1042044200 already unused, calling callback (ffffffffc1581350) 00010000:00010000:3.0:1789265412.986712:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000019e4767a/0x27274ba5bb9531cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.986739:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000019e4767a/0x27274ba5bb9531cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.986760:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000019e4767a/0x27274ba5bb9531cd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.986768:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019e4767a/0x27274ba5bb9531cd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.989713:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265412.989723:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265412.989726:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789265412.993583:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789265412.993602:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000066f731e/0x27274ba5bb9531d4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.993626:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=458s v=(0 0) 00010000:00010000:3.0:1789265412.993631:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265412.993639:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000066f731e/0x27274ba5bb9531d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.993656:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000066f731e/0x27274ba5bb9531d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.993668:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000066f731e/0x27274ba5bb9531d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.993686:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000066f731e/0x27274ba5bb9531d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.993703:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789265412.994628:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265412.994643:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000066f731e/0x27274ba5bb9531d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265412.994656:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1042044000 already unused, calling callback (ffffffffc1581350) 00010000:00010000:1.0:1789265412.994662:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000066f731e/0x27274ba5bb9531d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265412.994684:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000066f731e/0x27274ba5bb9531d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265412.994711:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000066f731e/0x27274ba5bb9531d4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265412.994718:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000066f731e/0x27274ba5bb9531d4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265412.994747:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265412.994748:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265412.994750:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789265412.998284:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:3.0:1789265412.998739:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789265412.998751:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d5d7289/0x27274ba5bb9531db lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.998773:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=458s v=(0 0) 00010000:00010000:3.0:1789265412.998779:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265413.000257:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d5d7289/0x27274ba5bb9531db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265413.000297:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d5d7289/0x27274ba5bb9531db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265413.000312:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d5d7289/0x27274ba5bb9531db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265413.000320:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002d5d7289/0x27274ba5bb9531db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265413.000483:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265413.000492:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002d5d7289/0x27274ba5bb9531db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265413.000515:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1042045200 already unused, calling callback (ffffffffc1581350) 00010000:00010000:0.0:1789265413.000520:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002d5d7289/0x27274ba5bb9531db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265413.000530:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002d5d7289/0x27274ba5bb9531db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265413.000552:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002d5d7289/0x27274ba5bb9531db lrc: 2/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265413.000564:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265413.000566:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265413.000568:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265413.000655:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789265413.000661:0:14987:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d5d7289/0x27274ba5bb9531db lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789265413.002565:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789265413.002581:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019e4767a/0x27274ba5bb9531e2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265413.002601:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=458s v=(0 0) 00010000:00010000:3.0:1789265413.002606:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265413.002614:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019e4767a/0x27274ba5bb9531e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265413.002630:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019e4767a/0x27274ba5bb9531e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265413.002641:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019e4767a/0x27274ba5bb9531e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265413.002647:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000019e4767a/0x27274ba5bb9531e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265413.002669:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789265413.003239:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265413.003250:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000019e4767a/0x27274ba5bb9531e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265413.003261:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1042044200 already unused, calling callback (ffffffffc1581350) 00010000:00010000:1.0:1789265413.003265:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000019e4767a/0x27274ba5bb9531e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265413.003276:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000019e4767a/0x27274ba5bb9531e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265413.003300:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000019e4767a/0x27274ba5bb9531e2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265413.003326:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019e4767a/0x27274ba5bb9531e2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265413.003366:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265413.003368:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265413.003370:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789265413.004889:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789265413.004904:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8fedfe5/0x27274ba5bb9531e9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265413.004923:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=458s v=(0 0) 00010000:00010000:3.0:1789265413.004928:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265413.004943:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8fedfe5/0x27274ba5bb9531e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265413.004959:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e8fedfe5/0x27274ba5bb9531e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265413.004971:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8fedfe5/0x27274ba5bb9531e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265413.004979:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e8fedfe5/0x27274ba5bb9531e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265413.005000:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789265413.005389:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265413.005399:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e8fedfe5/0x27274ba5bb9531e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265413.005408:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1042045a00 already unused, calling callback (ffffffffc1581350) 00010000:00010000:0.0:1789265413.005414:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8fedfe5/0x27274ba5bb9531e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265413.005424:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8fedfe5/0x27274ba5bb9531e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265413.005446:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e8fedfe5/0x27274ba5bb9531e9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265413.005463:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e8fedfe5/0x27274ba5bb9531e9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265413.005487:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265413.005489:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265413.005491:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789265413.006625:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789265413.006638:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fbf3ce4d/0x27274ba5bb9531f0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265413.006656:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=458s v=(0 0) 00010000:00010000:3.0:1789265413.006662:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265413.006669:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fbf3ce4d/0x27274ba5bb9531f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265413.006685:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fbf3ce4d/0x27274ba5bb9531f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265413.006694:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fbf3ce4d/0x27274ba5bb9531f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265413.006714:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fbf3ce4d/0x27274ba5bb9531f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265413.006747:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789265413.007417:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789265413.007425:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000972db08d/0x27274ba5bb9531f7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265413.007438:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=458s v=(0 0) 00010000:00010000:3.0:1789265413.007441:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265413.007446:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000972db08d/0x27274ba5bb9531f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265413.007457:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000972db08d/0x27274ba5bb9531f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265413.007466:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000972db08d/0x27274ba5bb9531f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265413.007474:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000972db08d/0x27274ba5bb9531f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265413.007489:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1789265413.007943:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789265413.007949:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005fcb724a/0x27274ba5bb9531fe lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265413.007967:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=458s v=(0 0) 00010000:00010000:3.0:1789265413.007969:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265413.007973:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005fcb724a/0x27274ba5bb9531fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265413.007983:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005fcb724a/0x27274ba5bb9531fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265413.007992:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005fcb724a/0x27274ba5bb9531fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265413.007999:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005fcb724a/0x27274ba5bb9531fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265413.008008:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1789265413.008289:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789265413.008298:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fbf3ce4d/0x27274ba5bb9531f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265413.008308:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1042044600 already unused, calling callback (ffffffffc1581350) 00010000:00010000:0.0:1789265413.008312:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fbf3ce4d/0x27274ba5bb9531f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265413.008321:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fbf3ce4d/0x27274ba5bb9531f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265413.008344:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fbf3ce4d/0x27274ba5bb9531f0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265413.008351:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fbf3ce4d/0x27274ba5bb9531f0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265413.008406:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789265413.008410:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000972db08d/0x27274ba5bb9531f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265413.008424:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1042044800 already unused, calling callback (ffffffffc1581350) 00010000:00010000:0.0:1789265413.008428:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000972db08d/0x27274ba5bb9531f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265413.008436:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000972db08d/0x27274ba5bb9531f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265413.008448:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000972db08d/0x27274ba5bb9531f7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265413.008455:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000972db08d/0x27274ba5bb9531f7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265413.008468:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265413.008472:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005fcb724a/0x27274ba5bb9531fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265413.008478:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1042045800 already unused, calling callback (ffffffffc1581350) 00010000:00010000:0.0:1789265413.008481:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005fcb724a/0x27274ba5bb9531fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265413.008488:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005fcb724a/0x27274ba5bb9531fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265413.008497:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005fcb724a/0x27274ba5bb9531fe lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265413.008510:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005fcb724a/0x27274ba5bb9531fe lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265413.008526:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265413.008528:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265413.008530:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265413.009239:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789265413.009530:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789265413.009541:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d416beb4/0x27274ba5bb953205 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265413.009557:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=458s v=(0 0) 00010000:00010000:3.0:1789265413.009563:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265413.009571:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d416beb4/0x27274ba5bb953205 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265413.009586:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d416beb4/0x27274ba5bb953205 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265413.009610:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d416beb4/0x27274ba5bb953205 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265413.009618:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d416beb4/0x27274ba5bb953205 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265413.009643:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789265413.009902:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265413.009911:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d416beb4/0x27274ba5bb953205 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265413.009921:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1042045c00 already unused, calling callback (ffffffffc1581350) 00010000:00010000:0.0:1789265413.009927:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d416beb4/0x27274ba5bb953205 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265413.009935:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d416beb4/0x27274ba5bb953205 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265413.009954:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d416beb4/0x27274ba5bb953205 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265413.009961:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d416beb4/0x27274ba5bb953205 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265413.009984:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265413.009986:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265413.009988:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789265413.011673:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789265413.011690:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1512bf7/0x27274ba5bb95320c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265413.011710:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=458s v=(0 0) 00010000:00010000:3.0:1789265413.011715:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265413.011721:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1512bf7/0x27274ba5bb95320c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265413.011737:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1512bf7/0x27274ba5bb95320c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265413.011749:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1512bf7/0x27274ba5bb95320c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265413.011757:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1512bf7/0x27274ba5bb95320c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265413.011875:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789265413.012570:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265413.012581:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1512bf7/0x27274ba5bb95320c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265413.012592:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1042045000 already unused, calling callback (ffffffffc1581350) 00010000:00010000:1.0:1789265413.012598:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1512bf7/0x27274ba5bb95320c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265413.012608:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1512bf7/0x27274ba5bb95320c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265413.012633:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1512bf7/0x27274ba5bb95320c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265413.012642:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1512bf7/0x27274ba5bb95320c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265413.012674:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265413.012676:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265413.012688:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789265413.014719:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789265413.014734:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa6cbeb2/0x27274ba5bb953213 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265413.014753:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=458s v=(0 0) 00010000:00010000:3.0:1789265413.014758:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265413.014765:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa6cbeb2/0x27274ba5bb953213 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265413.014781:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa6cbeb2/0x27274ba5bb953213 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265413.015934:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa6cbeb2/0x27274ba5bb953213 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265413.015949:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aa6cbeb2/0x27274ba5bb953213 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265413.015992:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789265413.016540:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265413.016550:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aa6cbeb2/0x27274ba5bb953213 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265413.016560:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a0f03143000 already unused, calling callback (ffffffffc1581350) 00010000:00010000:0.0:1789265413.016565:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa6cbeb2/0x27274ba5bb953213 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265413.016575:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa6cbeb2/0x27274ba5bb953213 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265413.016600:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aa6cbeb2/0x27274ba5bb953213 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265413.016608:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa6cbeb2/0x27274ba5bb953213 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265413.016642:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265413.016644:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265413.016645:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789265413.019625:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789265413.019643:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f20d5b38/0x27274ba5bb95321a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265413.019665:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=458s v=(0 0) 00010000:00010000:3.0:1789265413.019677:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265413.019685:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f20d5b38/0x27274ba5bb95321a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265413.019703:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f20d5b38/0x27274ba5bb95321a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265413.019716:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f20d5b38/0x27274ba5bb95321a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265413.019726:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f20d5b38/0x27274ba5bb95321a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265413.019758:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789265413.020158:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265413.020169:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f20d5b38/0x27274ba5bb95321a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265413.020178:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a0f03143c00 already unused, calling callback (ffffffffc1581350) 00010000:00010000:1.0:1789265413.020184:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f20d5b38/0x27274ba5bb95321a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265413.020194:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f20d5b38/0x27274ba5bb95321a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265413.020217:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f20d5b38/0x27274ba5bb95321a lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265413.020235:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f20d5b38/0x27274ba5bb95321a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265413.020264:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265413.020266:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265413.020268:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789265413.028882:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789265413.028903:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000947314dc/0x27274ba5bb953221 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265413.028927:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=458s v=(0 0) 00010000:00010000:3.0:1789265413.028932:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265413.028939:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000947314dc/0x27274ba5bb953221 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265413.028955:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000947314dc/0x27274ba5bb953221 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265413.028967:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000947314dc/0x27274ba5bb953221 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265413.028984:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000947314dc/0x27274ba5bb953221 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265413.029017:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789265413.029625:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789265413.029633:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e131a217/0x27274ba5bb953228 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265413.029644:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=458s v=(0 0) 00010000:00010000:3.0:1789265413.029648:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265413.029653:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e131a217/0x27274ba5bb953228 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265413.029662:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e131a217/0x27274ba5bb953228 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265413.029671:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e131a217/0x27274ba5bb953228 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265413.029679:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e131a217/0x27274ba5bb953228 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265413.029700:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1789265413.030135:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789265413.030142:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e170461/0x27274ba5bb95322f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265413.030158:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=458s v=(0 0) 00010000:00010000:3.0:1789265413.030162:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265413.030166:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e170461/0x27274ba5bb95322f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265413.030175:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e170461/0x27274ba5bb95322f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265413.030183:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e170461/0x27274ba5bb95322f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265413.030190:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e170461/0x27274ba5bb95322f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265413.030199:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00080000:3.0:1789265413.030433:0:14987:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:3.0:1789265413.030566:0:14987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02df4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14329:x1876180414333568:12345-0@lo:5:osp-pre-1-0.0 Request processed in 104329us (105704us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265413.030578:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789265413.031001:0:14329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02df6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14329:1876180414333568:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1789265413.031023:0:14329:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:1.0:1789265413.031151:0:14329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02df6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14329:1876180414333696:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1789265413.031202:0:14329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265413.031254:0:14329:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a103bcdb300 going to sleep for 11 seconds 00000100:00100000:1.0:1789265413.031287:0:14990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414333696 00000100:00100000:1.0:1789265413.031295:0:14990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414333696 00000100:00100000:1.0:1789265413.031362:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789265413.031373:0:14990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02df6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14329:x1876180414333696:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1789265413.031423:0:14990:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:0.0:1789265413.032780:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789265413.032797:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000947314dc/0x27274ba5bb953221 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265413.032815:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a0f03142c00 already unused, calling callback (ffffffffc1581350) 00010000:00010000:0.0:1789265413.032821:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000947314dc/0x27274ba5bb953221 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265413.032852:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000947314dc/0x27274ba5bb953221 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265413.033099:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000947314dc/0x27274ba5bb953221 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265413.033110:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000947314dc/0x27274ba5bb953221 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265413.033217:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789265413.033223:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e131a217/0x27274ba5bb953228 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265413.033231:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a0f03143400 already unused, calling callback (ffffffffc1581350) 00010000:00010000:0.0:1789265413.033235:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e131a217/0x27274ba5bb953228 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265413.033244:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e131a217/0x27274ba5bb953228 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265413.033257:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e131a217/0x27274ba5bb953228 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265413.033265:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e131a217/0x27274ba5bb953228 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265413.033299:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265413.033304:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e170461/0x27274ba5bb95322f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265413.033312:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a0f03143e00 already unused, calling callback (ffffffffc1581350) 00010000:00010000:0.0:1789265413.033316:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e170461/0x27274ba5bb95322f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265413.033326:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e170461/0x27274ba5bb95322f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265413.033338:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e170461/0x27274ba5bb95322f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265413.033346:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e170461/0x27274ba5bb95322f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265413.033376:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265413.033379:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265413.033382:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265413.034717:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265413.038057:0:14329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02df6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14329:1876180414333696:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1789265413.038179:0:14329:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:1.0:1789265413.038323:0:14990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02df6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14329:x1876180414333696:12345-0@lo:5:osp-pre-1-0.0 Request processed in 6419us (6589us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1789265413.038336:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000001:00080000:0.0:1789265413.518486:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1789265413.518514:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1789265413.555604:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265414.580069:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265414.962282:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789265414.962305:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1016d46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414333824:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789265414.962381:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265414.962499:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414333824 00000100:00100000:1.0:1789265414.962508:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414333824 00000100:00100000:1.0:1789265414.962579:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789265414.962588:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1016d47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414333824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789265414.962623:0:14991:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789265414.962676:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1016d47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414333824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265414.962683:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789265414.962730:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1016d46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414333824:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789265414.962848:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789265415.602402:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789265415.813753:0:16069:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg337-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789265416.627563:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265417.656014:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265417.810875:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265417.811562:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397563776 00000100:00100000:0.0:1789265417.811574:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397563776 00000100:00100000:0.0:1789265417.811628:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 75 00000100:00100000:0.0:1789265417.811636:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103b821450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2347:x1876180397563776:12345-192.168.203.37@tcp:250:mount.lustre.0 00010000:00080000:0.0:1789265417.811661:0:14299:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 6a430b7c-fa3a-4f96-b1b6-57fba480f0e0@192.168.203.37@tcp t0 exp 0000000000000000 cur 463 last 0 00000020:00000080:0.0:1789265417.811691:0:14299:0:(genops.c:1385:class_connect()) connect: client 6a430b7c-fa3a-4f96-b1b6-57fba480f0e0, cookie 0x27274ba5bb953236 00000100:00080000:0.0:1789265417.811832:0:14299:0:(import.c:65:import_set_state_nolock()) ffff8a103c0c7800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789265417.811915:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103b821450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+5:2347:x1876180397563776:12345-192.168.203.37@tcp:250:mount.lustre.0 Request processed in 278us (1048us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265417.811923:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 75 00000100:00100000:1.0:1789265417.819918:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265417.820201:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397563904 00000100:00100000:3.0:1789265417.820215:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397563904 00000100:00100000:3.0:1789265417.820299:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 76 00000100:00100000:3.0:1789265417.820313:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103b821c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+5:13713:x1876180397563904:12345-192.168.203.37@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789265417.820342:0:14298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265417.820385:0:14298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a0f03142a00/0x27274ba5bb95323d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x73b61075d99f017f expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.820423:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a0f03142a00/0x27274ba5bb95323d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f017f expref: 6 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.820437:0:14298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a0f03142a00/0x27274ba5bb95323d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f017f expref: 6 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265417.820449:0:14298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a0f03142a00, rc 0) 00000100:00100000:3.0:1789265417.820541:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103b821c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+6:13713:x1876180397563904:12345-192.168.203.37@tcp:101:mount.lustre.0 Request processed in 231us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265417.820549:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 76 00000100:00100000:0.0:1789265417.836696:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265417.836927:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397564032 00000100:00100000:2.0:1789265417.836945:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397564032 00000100:00100000:2.0:1789265417.837036:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 77 00000100:00100000:2.0:1789265417.837051:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103b823c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+6:13713:x1876180397564032:12345-192.168.203.37@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789265417.837804:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103b823c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+6:13713:x1876180397564032:12345-192.168.203.37@tcp:501:mount.lustre.0 Request processed in 752us (1117us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789265417.837816:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 77 00000100:00100000:2.0:1789265417.842724:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265417.844582:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397564160 00000100:00100000:0.0:1789265417.844602:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397564160 00000100:00100000:0.0:1789265417.844686:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 78 00000100:00100000:0.0:1789265417.844698:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103b820c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+6:13713:x1876180397564160:12345-192.168.203.37@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789265417.844719:0:14298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265417.844741:0:14298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a103fa34e00/0x27274ba5bb953244 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x73b61075d99f0186 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.844778:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a103fa34e00/0x27274ba5bb953244 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0186 expref: 7 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.844792:0:14298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a103fa34e00/0x27274ba5bb953244 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0186 expref: 7 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.844822:0:14298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fa34e00, rc 0) 00000100:00100000:0.0:1789265417.844919:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103b820c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+7:13713:x1876180397564160:12345-192.168.203.37@tcp:101:mount.lustre.0 Request processed in 224us (2208us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265417.844927:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 78 00000100:00100000:1.0:1789265417.855228:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265417.855384:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397564288 00000100:00100000:0.0:1789265417.855397:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397564288 00000100:00100000:0.0:1789265417.855476:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 79 00000100:00100000:0.0:1789265417.855488:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103b823050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+7:13713:x1876180397564288:12345-192.168.203.37@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789265417.856122:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103b823050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+8:13713:x1876180397564288:12345-192.168.203.37@tcp:501:mount.lustre.0 Request processed in 633us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265417.856132:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 79 00000100:00100000:1.0:1789265417.858535:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265417.858682:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397564416 00000100:00100000:2.0:1789265417.858695:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397564416 00000100:00100000:2.0:1789265417.858812:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 80 00000100:00100000:2.0:1789265417.858825:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103b822450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+8:13713:x1876180397564416:12345-192.168.203.37@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789265417.859386:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103b822450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+8:13713:x1876180397564416:12345-192.168.203.37@tcp:503:mount.lustre.0 Request processed in 562us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265417.859395:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 80 00000100:00100000:0.0:1789265417.867162:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265417.868912:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397564544 00000100:00100000:3.0:1789265417.868934:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397564544 00000100:00100000:3.0:1789265417.869034:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 81 00000100:00100000:3.0:1789265417.869047:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103b821850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+8:13731:x1876180397564544:12345-192.168.203.37@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789265417.869992:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103b821850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+8:13731:x1876180397564544:12345-192.168.203.37@tcp:502:llog_process_th.0 Request processed in 941us (2839us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265417.870007:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 81 00000100:00100000:1.0:1789265417.884835:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265417.886620:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397564672 00000100:00100000:2.0:1789265417.886642:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397564672 00000100:00100000:2.0:1789265417.886735:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 82 00000100:00100000:2.0:1789265417.886749:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103b820050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+8:13731:x1876180397564672:12345-192.168.203.37@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789265417.887398:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103b820050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+8:13731:x1876180397564672:12345-192.168.203.37@tcp:502:llog_process_th.0 Request processed in 649us (2636us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265417.887407:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 82 00000100:00100000:1.0:1789265417.902462:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265417.903344:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397564800 00000100:00100000:0.0:1789265417.903360:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397564800 00000100:00100000:0.0:1789265417.903446:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 83 00000100:00100000:0.0:1789265417.903459:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103b822050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+8:13713:x1876180397564800:12345-192.168.203.37@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789265417.903490:0:14298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265417.903517:0:14298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a103fa35a00/0x27274ba5bb95324b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x73b61075d99f01b0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.903555:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a103fa35a00/0x27274ba5bb95324b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f01b0 expref: 9 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.903568:0:14298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a103fa35a00/0x27274ba5bb95324b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f01b0 expref: 9 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265417.903606:0:14298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fa35a00, rc 0) 00000100:00100000:0.0:1789265417.903692:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103b822050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+9:13713:x1876180397564800:12345-192.168.203.37@tcp:101:mount.lustre.0 Request processed in 236us (1245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265417.903701:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 83 00000100:00100000:0.0:1789265417.911610:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265417.911723:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397564928 00000100:00100000:3.0:1789265417.911737:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397564928 00000100:00100000:3.0:1789265417.911817:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 84 00000100:00100000:3.0:1789265417.911831:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103b822850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+9:13713:x1876180397564928:12345-192.168.203.37@tcp:256:mount.lustre.0 20000000:01000000:3.0:1789265417.911866:0:14299:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789265417.911894:0:14299:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789265417.912059:0:14299:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789265417.912064:0:14299:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789265417.912264:0:14299:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1789265417.919820:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103b822850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+9:13713:x1876180397564928:12345-192.168.203.37@tcp:256:mount.lustre.0 Request processed in 7976us (8210us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265417.919838:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 84 00000100:00100000:1.0:1789265417.924805:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265417.925437:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397565056 00000100:00100000:2.0:1789265417.925452:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397565056 00000100:00100000:2.0:1789265417.925539:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 85 00000100:00100000:2.0:1789265417.925551:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103b822c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+9:13713:x1876180397565056:12345-192.168.203.37@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789265417.925585:0:14297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265417.925611:0:14297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a102e536000/0x27274ba5bb953252 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x73b61075d99f01b7 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265417.925649:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a102e536000/0x27274ba5bb953252 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f01b7 expref: 10 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265417.925664:0:14297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a102e536000/0x27274ba5bb953252 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f01b7 expref: 10 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265417.925675:0:14297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a102e536000, rc 0) 00000100:00100000:2.0:1789265417.925751:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103b822c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+10:13713:x1876180397565056:12345-192.168.203.37@tcp:101:mount.lustre.0 Request processed in 203us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265417.925766:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 85 00000100:00100000:0.0:1789265417.929200:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265417.929351:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397565184 00000100:00100000:2.0:1789265417.929365:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397565184 00000100:00100000:2.0:1789265417.929433:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 86 00000100:00100000:2.0:1789265417.929443:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008e19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+10:13713:x1876180397565184:12345-192.168.203.37@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789265417.929803:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008e19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+10:13713:x1876180397565184:12345-192.168.203.37@tcp:501:mount.lustre.0 Request processed in 360us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265417.929812:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 86 00000100:00100000:1.0:1789265417.932170:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265417.932277:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397565312 00000100:00100000:0.0:1789265417.932291:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397565312 00000100:00100000:0.0:1789265417.932371:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 87 00000100:00100000:0.0:1789265417.932383:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008e1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+10:13713:x1876180397565312:12345-192.168.203.37@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789265417.933141:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008e1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+10:13713:x1876180397565312:12345-192.168.203.37@tcp:503:mount.lustre.0 Request processed in 753us (977us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265417.933152:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 87 00000100:00100000:1.0:1789265417.935930:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265417.936314:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397565440 00000100:00100000:3.0:1789265417.936338:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397565440 00000100:00100000:3.0:1789265417.936461:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 88 00000100:00100000:3.0:1789265417.936485:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008e18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+10:13735:x1876180397565440:12345-192.168.203.37@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789265417.936874:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008e18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+10:13735:x1876180397565440:12345-192.168.203.37@tcp:502:llog_process_th.0 Request processed in 401us (957us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265417.936885:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 88 00000100:00100000:2.0:1789265417.940601:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265417.943631:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397565568 00000100:00100000:0.0:1789265417.943655:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397565568 00000100:00100000:0.0:1789265417.944226:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 89 00000100:00100000:0.0:1789265417.944245:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008e19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+10:13735:x1876180397565568:12345-192.168.203.37@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789265417.944574:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008e19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+10:13735:x1876180397565568:12345-192.168.203.37@tcp:502:llog_process_th.0 Request processed in 334us (3986us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265417.947300:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 89 00000100:00100000:1.0:1789265417.955261:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265417.955405:0:15928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397565696 00000100:00100000:2.0:1789265417.955420:0:15928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397565696 00000100:00100000:2.0:1789265417.955488:0:15928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 4 00000100:00100000:2.0:1789265417.955498:0:15928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02df4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2347:x1876180397565696:12345-192.168.203.37@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789265417.955539:0:15928:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from a1015321-b6f2-4e27-98e4-70a40da05f32@192.168.203.37@tcp t0 exp 0000000000000000 cur 463 last 0 00000020:00000080:2.0:1789265417.955638:0:15928:0:(genops.c:1385:class_connect()) connect: client a1015321-b6f2-4e27-98e4-70a40da05f32, cookie 0x27274ba5bb953259 00000004:00100000:2.0:1789265417.955682:0:15928:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1789265417.955690:0:15928:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:3.0:1789265418.035886:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:3316:1876180414333952:0@lo:400:kworker.0 00000100:00100000:3.0:1789265418.035997:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265418.036062:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1876180414334464:0@lo:400:kworker.0 00000100:00100000:3.0:1789265418.036117:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265418.036149:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789265418.036155:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876180414334336:0@lo:400:kworker.0 00000100:00100000:3.0:1789265418.036179:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265418.036211:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414334080:0@lo:400:kworker.0 00000100:00100000:3.0:1789265418.036239:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265418.036258:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1876180414334592:0@lo:400:kworker.0 00000100:00100000:3.0:1789265418.036282:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265418.036304:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789265418.036310:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414334208:0@lo:400:kworker.0 00000100:00100000:3.0:1789265418.036346:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265418.036387:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414334464 00000100:00100000:3.0:1789265418.036397:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414334464 00000100:00100000:3.0:1789265418.036456:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414334336 00000100:00100000:3.0:1789265418.036460:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414334336 00000100:00100000:3.0:1789265418.036496:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414334592 00000100:00100000:3.0:1789265418.036500:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414334592 00000100:00100000:3.0:1789265418.036544:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789265418.036554:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1876180414334464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265418.038909:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1876180414334464:12345-0@lo:400:kworker.0 Request processed in 2346us (2781us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265418.038926:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789265418.038975:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789265418.038990:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876180414334336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265418.039026:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876180414334336:12345-0@lo:400:kworker.0 Request processed in 43us (2846us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265418.039033:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789265418.039048:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789265418.039058:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1876180414334592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265418.039114:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1876180414334592:12345-0@lo:400:kworker.0 Request processed in 58us (2831us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265418.039121:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789265418.039162:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414334080 00000100:00100000:3.0:1789265418.039173:0:14987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414334080 00000100:00100000:3.0:1789265418.039223:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414334208 00000100:00100000:3.0:1789265418.039227:0:14987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414334208 00000100:00100000:3.0:1789265418.039245:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789265418.039252:0:14987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1876180414334080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265418.039290:0:14987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1876180414334080:12345-0@lo:400:kworker.0 Request processed in 39us (3049us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265418.039297:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789265418.039308:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789265418.039348:0:14987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103ba7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1876180414334208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265418.039384:0:14987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103ba7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1876180414334208:12345-0@lo:400:kworker.0 Request processed in 38us (3037us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265418.039390:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789265418.039444:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a0f02da1180 x1876180414334336/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265418.039463:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876180414334336:0@lo:400:kworker.0 00010000:00080000:3.0:1789265418.039480:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a0f02da1880 x1876180414334464/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265418.039489:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1876180414334464:0@lo:400:kworker.0 00000100:00100000:3.0:1789265418.039533:0:3317:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1789265418.041374:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414333952 00000100:00100000:2.0:1789265418.041393:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414333952 00000100:00100000:2.0:1789265418.041460:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789265418.041471:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008e18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+19:3316:x1876180414333952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265418.041744:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414334208:0@lo:400:kworker.0 00000100:00100000:2.0:1789265418.041897:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008e18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+19:3316:x1876180414333952:12345-0@lo:400:kworker.0 Request processed in 427us (5899us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265418.041905:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789265418.044948:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1016d44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414334720:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789265418.045055:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789265418.045157:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789265418.045165:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789265418.045169:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265418.046840:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414334080:0@lo:400:kworker.0 00010000:00080000:3.0:1789265418.046867:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a0f02da3480 x1876180414334592/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265418.046880:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1876180414334592:0@lo:400:kworker.0 00000100:00100000:3.0:1789265418.046965:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:3316:1876180414333952:0@lo:400:kworker.0 00000100:00100000:2.0:1789265418.054361:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414334720 00000100:00100000:2.0:1789265418.054383:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414334720 00000100:00100000:2.0:1789265418.054465:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789265418.054477:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02df5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876180414334720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789265418.054530:0:14991:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789265418.061954:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02df5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876180414334720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 7465us (16885us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265418.061974:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789265418.062386:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1016d44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414334720:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789265418.067515:0:15928:0:(import.c:65:import_set_state_nolock()) ffff8a103c0c4800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789265418.067857:0:15928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02df4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1015321-b6f2-4e27-98e4-70a40da05f32+6:2347:x1876180397565696:12345-192.168.203.37@tcp:38:mount.lustre.0 Request processed in 112355us (112608us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265418.067889:0:15928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 4 00000100:00100000:0.0:1789265418.081203:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265418.081253:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265418.081398:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397565952 00000100:00100000:1.0:1789265418.081412:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397565952 00000100:00100000:1.0:1789265418.081534:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397565824 00000100:00100000:1.0:1789265418.081539:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397565824 00000100:00100000:1.0:1789265418.081580:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 5 00000100:00100000:1.0:1789265418.081600:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1016d44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1015321-b6f2-4e27-98e4-70a40da05f32+7:13713:x1876180397565952:12345-192.168.203.37@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789265418.081660:0:14304:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789265418.083881:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1016d44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1015321-b6f2-4e27-98e4-70a40da05f32+7:13713:x1876180397565952:12345-192.168.203.37@tcp:41:mount.lustre.0 Request processed in 2265us (2674us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265418.083900:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 5 00000100:00100000:1.0:1789265418.083970:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 6 00000100:00100000:1.0:1789265418.083993:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1016d47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1015321-b6f2-4e27-98e4-70a40da05f32+6:0:x1876180397565824:12345-192.168.203.37@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789265418.084031:0:14304:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789265418.084123:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1016d47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1015321-b6f2-4e27-98e4-70a40da05f32+6:0:x1876180397565824:12345-192.168.203.37@tcp:41:mount.lustre.0 Request processed in 142us (2868us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265418.084130:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 6 00000100:00100000:2.0:1789265418.086966:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265418.087376:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397566080 00000100:00100000:1.0:1789265418.087391:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397566080 00000100:00100000:1.0:1789265418.087477:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 7 00000100:00100000:1.0:1789265418.087490:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102eecd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1015321-b6f2-4e27-98e4-70a40da05f32+6:13713:x1876180397566080:12345-192.168.203.37@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789265418.087651:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102eecd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1015321-b6f2-4e27-98e4-70a40da05f32+6:13713:x1876180397566080:12345-192.168.203.37@tcp:40:mount.lustre.0 Request processed in 162us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265418.087660:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 7 00000100:00080000:0.0:1789265418.089897:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265418.091034:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265418.092180:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265418.092225:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265418.092466:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397566208 00000100:00100000:3.0:1789265418.092489:0:14987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397566208 00000100:00100000:3.0:1789265418.092543:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397566336 00000100:00100000:3.0:1789265418.092546:0:14987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397566336 00000100:00100000:0.0:1789265418.092929:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397566464 00000100:00100000:0.0:1789265418.092936:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397566464 00000100:00100000:0.0:1789265418.092985:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 0 00000100:00100000:0.0:1789265418.092998:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02df5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1015321-b6f2-4e27-98e4-70a40da05f32+6:13713:x1876180397566464:12345-192.168.203.37@tcp:33:mount.lustre.0 00000100:00100000:2.0:1789265418.093227:0:14989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 8 00000100:00100000:2.0:1789265418.093235:0:14989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02df5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2347:x1876180397566208:12345-192.168.203.37@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789265418.093267:0:14989:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from a1015321-b6f2-4e27-98e4-70a40da05f32@192.168.203.37@tcp t0 exp 0000000000000000 cur 463 last 0 00000020:00000080:2.0:1789265418.093305:0:14989:0:(genops.c:1385:class_connect()) connect: client a1015321-b6f2-4e27-98e4-70a40da05f32, cookie 0x27274ba5bb953260 00002000:00100000:2.0:1789265418.093331:0:14989:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a1015321-b6f2-4e27-98e4-70a40da05f32/ffff8a1016d24800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113969 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789265418.093361:0:14989:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000004:00080000:3.0:1789265418.094573:0:14307:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1464us 00002000:00080000:2.0:1789265418.095357:0:14989:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789265418.095415:0:14989:0:(import.c:65:import_set_state_nolock()) ffff8a1016d25800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789265418.097897:0:14989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02df5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1015321-b6f2-4e27-98e4-70a40da05f32+6:2347:x1876180397566208:12345-192.168.203.37@tcp:8:mount.lustre.0 Request processed in 4645us (5708us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265418.097916:0:14989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 8 00000100:00100000:2.0:1789265418.098162:0:14989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 9 00000100:00100000:2.0:1789265418.098171:0:14989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02df6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2347:x1876180397566336:12345-192.168.203.37@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789265418.098215:0:14989:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from a1015321-b6f2-4e27-98e4-70a40da05f32@192.168.203.37@tcp t0 exp 0000000000000000 cur 463 last 0 00000020:00000080:2.0:1789265418.098255:0:14989:0:(genops.c:1385:class_connect()) connect: client a1015321-b6f2-4e27-98e4-70a40da05f32, cookie 0x27274ba5bb953267 00002000:00100000:2.0:1789265418.098272:0:14989:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a1015321-b6f2-4e27-98e4-70a40da05f32/ffff8a1016d20800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113969 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789265418.098285:0:14989:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789265418.101443:0:14989:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789265418.101502:0:14989:0:(import.c:65:import_set_state_nolock()) ffff8a1016d23000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789265418.103156:0:14989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02df6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1015321-b6f2-4e27-98e4-70a40da05f32+6:2347:x1876180397566336:12345-192.168.203.37@tcp:8:mount.lustre.0 Request processed in 4967us (10914us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265418.103177:0:14989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 9 00000004:00200000:1.0:1789265418.130370:0:14307:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1789265418.130585:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02df5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1015321-b6f2-4e27-98e4-70a40da05f32+6:13713:x1876180397566464:12345-192.168.203.37@tcp:33:mount.lustre.0 Request processed in 37580us (39552us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265418.130612:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 0 00000100:00100000:3.0:1789265418.315022:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265418.315260:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397566592 00000100:00100000:1.0:1789265418.315278:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397566592 00000100:00100000:1.0:1789265418.315373:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 8 00000100:00100000:1.0:1789265418.315385:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103ba7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1015321-b6f2-4e27-98e4-70a40da05f32+6:13756:x1876180397566592:12345-192.168.203.37@tcp:101:mkdir.0 00010000:00010000:1.0:1789265418.315412:0:14306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265418.315446:0:14306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597400/0x27274ba5bb95326e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f01e1 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265418.315530:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597000/0x27274ba5bb953275 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265418.315548:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597000/0x27274ba5bb953275 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265418.315566:0:14306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597000/0x27274ba5bb953275 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265418.315614:0:14306:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789265418.315625:0:14306:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789265418.315674:0:14306:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597000/0x27274ba5bb953275 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265418.315707:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597400/0x27274ba5bb95326e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f01e1 expref: 8 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265418.315729:0:14306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597000/0x27274ba5bb953275 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f01e1 expref: 7 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265418.315740:0:14306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a101cdf4f00) 00010000:00010000:1.0:1789265418.315743:0:14306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789265418.315747:0:14306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a101b597000, rc 0) 00000100:00100000:1.0:1789265418.315888:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103ba7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1015321-b6f2-4e27-98e4-70a40da05f32+7:13756:x1876180397566592:12345-192.168.203.37@tcp:101:mkdir.0 Request processed in 504us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265418.315897:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 8 00000001:00100000:2.0:1789265418.608350:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a1015321-b6f2-4e27-98e4-70a40da05f32 00010000:00010000:1.0:1789265418.674522:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265419.701746:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265420.082555:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1016d46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414334848:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789265420.082661:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265420.082924:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414334848 00000100:00100000:1.0:1789265420.082936:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414334848 00000100:00100000:1.0:1789265420.083031:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789265420.083043:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103ba79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414334848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789265420.083119:0:14992:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789265420.083192:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103ba79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414334848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 151us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265420.083200:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1789265420.083275:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265420.083375:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1016d46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414334848:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789265420.418025:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265420.419058:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397566720 00000100:00100000:1.0:1789265420.419113:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397566720 00000100:00080000:0.0:1789265420.419226:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265420.419236:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 9 00000100:00100000:1.0:1789265420.419259:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1016d46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1015321-b6f2-4e27-98e4-70a40da05f32+7:13809:x1876180397566720:12345-192.168.203.37@tcp:41:lfs.0 00000004:00000024:1.0:1789265420.419354:0:14304:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789265420.419487:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1016d46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1015321-b6f2-4e27-98e4-70a40da05f32+7:13809:x1876180397566720:12345-192.168.203.37@tcp:41:lfs.0 Request processed in 235us (1471us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265420.419496:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 9 00000100:00100000:0.0:1789265420.423485:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265420.423719:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397566848 00000100:00100000:1.0:1789265420.423729:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397566848 00000100:00100000:1.0:1789265420.423818:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 6 00000100:00100000:1.0:1789265420.423829:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1016d44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a1015321-b6f2-4e27-98e4-70a40da05f32+6:13809:x1876180397566848:12345-192.168.203.37@tcp:13:lfs.0 00002000:00000024:1.0:1789265420.423857:0:14992:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789265420.423954:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1016d44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a1015321-b6f2-4e27-98e4-70a40da05f32+6:13809:x1876180397566848:12345-192.168.203.37@tcp:13:lfs.0 Request processed in 126us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265420.423963:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 6 00000100:00080000:0.0:1789265420.424150:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265420.426224:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265420.426429:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397566976 00000100:00100000:1.0:1789265420.426439:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397566976 00000100:00080000:0.0:1789265420.426568:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789265420.426754:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 7 00000100:00100000:1.0:1789265420.426766:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103ba7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a1015321-b6f2-4e27-98e4-70a40da05f32+5:13809:x1876180397566976:12345-192.168.203.37@tcp:13:lfs.0 00002000:00000024:1.0:1789265420.426803:0:14992:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789265420.426891:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103ba7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a1015321-b6f2-4e27-98e4-70a40da05f32+5:13809:x1876180397566976:12345-192.168.203.37@tcp:13:lfs.0 Request processed in 127us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265420.426899:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 7 00000100:00100000:3.0:1789265420.640345:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265420.640410:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397567104 00000100:00100000:0.0:1789265420.640421:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397567104 00000100:00100000:0.0:1789265420.640475:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 91 00000100:00100000:0.0:1789265420.640484:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008e18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+10:13840:x1876180397567104:12345-192.168.203.37@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789265420.640502:0:14298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265420.640519:0:14298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a103fa35200/0x27274ba5bb95327c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x73b61075d99f01e8 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265420.640704:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a103fa35200/0x27274ba5bb95327c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f01e8 expref: 11 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265420.640721:0:14298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a103fa35200/0x27274ba5bb95327c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f01e8 expref: 11 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265420.640744:0:14298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fa35200, rc 0) 00000100:00100000:0.0:1789265420.640807:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008e18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+11:13840:x1876180397567104:12345-192.168.203.37@tcp:101:mount.lustre.0 Request processed in 323us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265420.640814:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 91 00000100:00100000:0.0:1789265420.649275:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265420.649495:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397567232 00000100:00100000:2.0:1789265420.649505:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397567232 00000100:00100000:2.0:1789265420.649577:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 92 00000100:00100000:2.0:1789265420.649588:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008e18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+11:13840:x1876180397567232:12345-192.168.203.37@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789265420.649887:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008e18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+11:13840:x1876180397567232:12345-192.168.203.37@tcp:501:mount.lustre.0 Request processed in 299us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265420.649895:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 92 00000100:00100000:3.0:1789265420.671393:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265420.673388:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397567360 00000100:00100000:0.0:1789265420.673404:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397567360 00000100:00100000:0.0:1789265420.673506:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 93 00000100:00100000:0.0:1789265420.673517:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008e1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+11:13840:x1876180397567360:12345-192.168.203.37@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789265420.673735:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008e1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+11:13840:x1876180397567360:12345-192.168.203.37@tcp:503:mount.lustre.0 Request processed in 220us (2352us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265420.673743:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 93 00000100:00100000:3.0:1789265420.682058:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265420.682197:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397567488 00000100:00100000:0.0:1789265420.682207:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397567488 00000100:00100000:0.0:1789265420.682267:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 94 00000100:00100000:0.0:1789265420.682278:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008e19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+11:13848:x1876180397567488:12345-192.168.203.37@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789265420.682692:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008e19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+11:13848:x1876180397567488:12345-192.168.203.37@tcp:502:llog_process_th.0 Request processed in 414us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265420.682701:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 94 00000100:00100000:1.0:1789265420.703114:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265420.703998:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397567616 00000100:00100000:0.0:1789265420.704010:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397567616 00000100:00100000:0.0:1789265420.704096:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 95 00000100:00100000:0.0:1789265420.704109:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008e1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+11:13848:x1876180397567616:12345-192.168.203.37@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789265420.705008:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008e1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+11:13848:x1876180397567616:12345-192.168.203.37@tcp:502:llog_process_th.0 Request processed in 897us (1926us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265420.705026:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 95 00000100:00100000:3.0:1789265420.715990:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265420.716310:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397567744 00000100:00100000:0.0:1789265420.716320:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397567744 00000100:00100000:0.0:1789265420.716374:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 96 00000100:00100000:0.0:1789265420.716384:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008e1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+11:13840:x1876180397567744:12345-192.168.203.37@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789265420.716399:0:14299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265420.716416:0:14299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a103fa34000/0x27274ba5bb953283 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x73b61075d99f0212 expref: -99 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265420.716442:0:14299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a103fa34000/0x27274ba5bb953283 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0212 expref: 12 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265420.716454:0:14299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a103fa34000/0x27274ba5bb953283 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0212 expref: 12 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265420.716463:0:14299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fa34000, rc 0) 00000100:00100000:0.0:1789265420.716522:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008e1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+12:13840:x1876180397567744:12345-192.168.203.37@tcp:101:mount.lustre.0 Request processed in 138us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265420.716529:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 96 00000100:00100000:3.0:1789265420.721962:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265420.722051:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397567872 00000100:00100000:0.0:1789265420.722061:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397567872 00000100:00100000:0.0:1789265420.722168:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 97 00000100:00100000:0.0:1789265420.722178:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008e1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+12:13840:x1876180397567872:12345-192.168.203.37@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789265420.722204:0:14298:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789265420.722228:0:14298:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789265420.722233:0:14298:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789265420.722236:0:14298:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789265420.722244:0:14298:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00010000:00010000:1.0:1789265420.722465:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265420.735058:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008e1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+12:13840:x1876180397567872:12345-192.168.203.37@tcp:256:mount.lustre.0 Request processed in 12871us (13095us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265420.735110:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 97 00000100:00100000:3.0:1789265420.742332:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265420.744124:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397568000 00000100:00100000:2.0:1789265420.744263:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397568000 00000100:00100000:2.0:1789265420.744389:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 98 00000100:00100000:2.0:1789265420.744399:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008e19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+12:13840:x1876180397568000:12345-192.168.203.37@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789265420.744415:0:14297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265420.744432:0:14297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a102e537400/0x27274ba5bb95328a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x73b61075d99f0219 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265420.744461:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a102e537400/0x27274ba5bb95328a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0219 expref: 13 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265420.744484:0:14297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a102e537400/0x27274ba5bb95328a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0219 expref: 13 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265420.744494:0:14297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a102e537400, rc 0) 00000100:00100000:2.0:1789265420.744563:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008e19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+13:13840:x1876180397568000:12345-192.168.203.37@tcp:101:mount.lustre.0 Request processed in 166us (2241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265420.744570:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 98 00000100:00100000:3.0:1789265420.751278:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265420.751572:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397568128 00000100:00100000:0.0:1789265420.751583:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397568128 00000100:00100000:0.0:1789265420.751653:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 99 00000100:00100000:0.0:1789265420.751663:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008e1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+13:13840:x1876180397568128:12345-192.168.203.37@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789265420.753273:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008e1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+13:13840:x1876180397568128:12345-192.168.203.37@tcp:501:mount.lustre.0 Request processed in 1601us (1994us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265420.753287:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 99 00000100:00100000:1.0:1789265420.767130:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265420.767314:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397568256 00000100:00100000:2.0:1789265420.767324:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397568256 00000100:00100000:2.0:1789265420.767379:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 100 00000100:00100000:2.0:1789265420.767388:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1008e1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+13:13840:x1876180397568256:12345-192.168.203.37@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789265420.767609:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1008e1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+13:13840:x1876180397568256:12345-192.168.203.37@tcp:503:mount.lustre.0 Request processed in 221us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265420.768979:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 100 00000100:00100000:2.0:1789265420.773469:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265420.773857:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397568384 00000100:00100000:0.0:1789265420.773868:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397568384 00000100:00100000:0.0:1789265420.773927:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 101 00000100:00100000:0.0:1789265420.773936:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1005516050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+13:13850:x1876180397568384:12345-192.168.203.37@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789265420.774213:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1005516050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+13:13850:x1876180397568384:12345-192.168.203.37@tcp:502:llog_process_th.0 Request processed in 277us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265420.774221:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 101 00000100:00100000:3.0:1789265420.782592:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265420.782835:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397568512 00000100:00100000:2.0:1789265420.782845:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397568512 00000100:00100000:2.0:1789265420.782913:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 102 00000100:00100000:2.0:1789265420.782923:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1005516450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+13:13850:x1876180397568512:12345-192.168.203.37@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789265420.783213:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1005516450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+13:13850:x1876180397568512:12345-192.168.203.37@tcp:502:llog_process_th.0 Request processed in 290us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265420.783221:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 102 00000100:00100000:1.0:1789265420.793393:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265420.793721:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397568640 00000100:00100000:3.0:1789265420.793731:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397568640 00000100:00100000:3.0:1789265420.793786:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 10 00000100:00100000:3.0:1789265420.793795:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02df6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2347:x1876180397568640:12345-192.168.203.37@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789265420.793822:0:14306:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 0402ccd4-bc8e-4a9b-ad20-843e6e477335@192.168.203.37@tcp t0 exp 0000000000000000 cur 466 last 0 00000020:00000080:3.0:1789265420.793858:0:14306:0:(genops.c:1385:class_connect()) connect: client 0402ccd4-bc8e-4a9b-ad20-843e6e477335, cookie 0x27274ba5bb953291 00000004:00100000:3.0:1789265420.793887:0:14306:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789265420.794015:0:14306:0:(import.c:65:import_set_state_nolock()) ffff8a1009019000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789265420.794117:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02df6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0402ccd4-bc8e-4a9b-ad20-843e6e477335+6:2347:x1876180397568640:12345-192.168.203.37@tcp:38:mount.lustre.0 Request processed in 321us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265420.794126:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 10 00000100:00100000:1.0:1789265420.794475:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265420.794583:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265420.794630:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265420.794649:0:14990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397569024 00000100:00100000:1.0:1789265420.794654:0:14990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397569024 00000100:00100000:1.0:1789265420.794683:0:14990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397568896 00000100:00100000:1.0:1789265420.794687:0:14990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397568896 00000100:00100000:1.0:1789265420.794701:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 4 00000100:00100000:1.0:1789265420.794708:0:14990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02df4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1015321-b6f2-4e27-98e4-70a40da05f32+5:2348:x1876180397569024:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789265420.794752:0:14990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02df4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1015321-b6f2-4e27-98e4-70a40da05f32+5:2348:x1876180397569024:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 44us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265420.794759:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 4 00000100:00100000:1.0:1789265420.794774:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 5 00000100:00100000:1.0:1789265420.794781:0:14990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02df7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1015321-b6f2-4e27-98e4-70a40da05f32+6:2348:x1876180397568896:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789265420.794803:0:14990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02df7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1015321-b6f2-4e27-98e4-70a40da05f32+6:2348:x1876180397568896:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 24us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265420.794809:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 5 00000100:00100000:2.0:1789265420.795268:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397568768 00000100:00100000:2.0:1789265420.795273:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397568768 00000100:00100000:2.0:1789265420.795320:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 16 00000100:00100000:2.0:1789265420.795327:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02df6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1015321-b6f2-4e27-98e4-70a40da05f32+7:2348:x1876180397568768:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789265420.795366:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02df6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1015321-b6f2-4e27-98e4-70a40da05f32+7:2348:x1876180397568768:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 40us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265420.795373:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 16 00000100:00100000:1.0:1789265420.802461:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265420.802819:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397569152 00000100:00100000:3.0:1789265420.802829:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397569152 00000100:00100000:3.0:1789265420.802900:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 11 00000100:00100000:3.0:1789265420.802922:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02df7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0402ccd4-bc8e-4a9b-ad20-843e6e477335+6:0:x1876180397569152:12345-192.168.203.37@tcp:41:mount.lustre.0 00000100:00080000:0.0:1789265420.803196:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:3.0:1789265420.805320:0:14306:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789265420.809883:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02df7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0402ccd4-bc8e-4a9b-ad20-843e6e477335+6:0:x1876180397569152:12345-192.168.203.37@tcp:41:mount.lustre.0 Request processed in 6950us (7419us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265420.809898:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 11 00000100:00100000:2.0:1789265420.813831:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265420.818337:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397569280 00000100:00100000:3.0:1789265420.818352:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397569280 00000100:00100000:2.0:1789265420.820406:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 12 00000100:00100000:2.0:1789265420.820420:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102eecd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0402ccd4-bc8e-4a9b-ad20-843e6e477335+6:13840:x1876180397569280:12345-192.168.203.37@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789265420.820453:0:14304:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789265420.820549:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102eecd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0402ccd4-bc8e-4a9b-ad20-843e6e477335+6:13840:x1876180397569280:12345-192.168.203.37@tcp:41:mount.lustre.0 Request processed in 131us (6726us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265420.820557:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 12 00000100:00100000:0.0:1789265420.826876:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265420.826969:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397569408 00000100:00100000:1.0:1789265420.826988:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397569408 00000100:00100000:1.0:1789265420.827043:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 13 00000100:00100000:1.0:1789265420.827054:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1016d46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0402ccd4-bc8e-4a9b-ad20-843e6e477335+6:13840:x1876180397569408:12345-192.168.203.37@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789265420.827330:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1016d46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0402ccd4-bc8e-4a9b-ad20-843e6e477335+6:13840:x1876180397569408:12345-192.168.203.37@tcp:40:mount.lustre.0 Request processed in 277us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265420.827339:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 13 00000100:00100000:3.0:1789265420.831388:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265420.831434:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265420.831465:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265420.831551:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397569792 00000100:00100000:0.0:1789265420.831566:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397569792 00000100:00100000:0.0:1789265420.831714:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 1 00000100:00100000:3.0:1789265420.831725:0:14307:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:0.0:1789265420.831728:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103ba7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0402ccd4-bc8e-4a9b-ad20-843e6e477335+6:13840:x1876180397569792:12345-192.168.203.37@tcp:33:mount.lustre.0 00000100:00100000:3.0:1789265420.831747:0:14307:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000004:00200000:0.0:1789265420.831807:0:14308:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1789265420.831909:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103ba7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0402ccd4-bc8e-4a9b-ad20-843e6e477335+6:13840:x1876180397569792:12345-192.168.203.37@tcp:33:mount.lustre.0 Request processed in 182us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265420.831933:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 1 00000100:00100000:2.0:1789265420.832314:0:14989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397569536 00000100:00100000:2.0:1789265420.832321:0:14989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397569536 00000100:00100000:2.0:1789265420.832348:0:14989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397569664 00000100:00100000:2.0:1789265420.832351:0:14989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397569664 00000100:00100000:2.0:1789265420.832362:0:14989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 10 00000100:00100000:2.0:1789265420.832369:0:14989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103ba78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2347:x1876180397569536:12345-192.168.203.37@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789265420.832403:0:14989:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 0402ccd4-bc8e-4a9b-ad20-843e6e477335@192.168.203.37@tcp t0 exp 0000000000000000 cur 466 last 0 00000020:00000080:2.0:1789265420.832430:0:14989:0:(genops.c:1385:class_connect()) connect: client 0402ccd4-bc8e-4a9b-ad20-843e6e477335, cookie 0x27274ba5bb953298 00002000:00100000:2.0:1789265420.832440:0:14989:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0402ccd4-bc8e-4a9b-ad20-843e6e477335/ffff8a103f9ad800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113969 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789265420.832451:0:14989:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789265420.832580:0:14989:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789265420.832610:0:14989:0:(import.c:65:import_set_state_nolock()) ffff8a103f9ab000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789265420.833393:0:14989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103ba78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0402ccd4-bc8e-4a9b-ad20-843e6e477335+6:2347:x1876180397569536:12345-192.168.203.37@tcp:8:mount.lustre.0 Request processed in 1021us (1954us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265420.833403:0:14989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 10 00000100:00100000:2.0:1789265420.833424:0:14989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 11 00000100:00100000:2.0:1789265420.833429:0:14989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103ba78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2347:x1876180397569664:12345-192.168.203.37@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789265420.833447:0:14989:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 0402ccd4-bc8e-4a9b-ad20-843e6e477335@192.168.203.37@tcp t0 exp 0000000000000000 cur 466 last 0 00000020:00000080:2.0:1789265420.833469:0:14989:0:(genops.c:1385:class_connect()) connect: client 0402ccd4-bc8e-4a9b-ad20-843e6e477335, cookie 0x27274ba5bb95329f 00002000:00100000:2.0:1789265420.833477:0:14989:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0402ccd4-bc8e-4a9b-ad20-843e6e477335/ffff8a103f9af000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113969 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789265420.833484:0:14989:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789265420.834901:0:14989:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789265420.834935:0:14989:0:(import.c:65:import_set_state_nolock()) ffff8a103f9ac000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789265420.835013:0:14989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103ba78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0402ccd4-bc8e-4a9b-ad20-843e6e477335+6:2347:x1876180397569664:12345-192.168.203.37@tcp:8:mount.lustre.0 Request processed in 1579us (3544us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265420.835022:0:14989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 11 00000100:00100000:0.0:1789265421.090540:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265421.090653:0:15928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397569920 00000100:00100000:1.0:1789265421.090669:0:15928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397569920 00000100:00100000:1.0:1789265421.090749:0:15928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 14 00000100:00100000:1.0:1789265421.090840:0:15928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1016d47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0402ccd4-bc8e-4a9b-ad20-843e6e477335+6:13871:x1876180397569920:12345-192.168.203.37@tcp:101:mkdir.0 00010000:00010000:1.0:1789265421.090860:0:15928:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265421.090881:0:15928:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb9532a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f0243 expref: -99 pid: 15928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265421.090946:0:15928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb9532ad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265421.090960:0:15928:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb9532ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265421.090971:0:15928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb9532ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265421.091004:0:15928:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789265421.091008:0:15928:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789265421.091025:0:15928:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb9532ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265421.091048:0:15928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596600/0x27274ba5bb9532a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0243 expref: 8 pid: 15928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265421.091066:0:15928:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb9532ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0243 expref: 7 pid: 15928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265421.091409:0:15928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a101cdf4f00) 00010000:00010000:1.0:1789265421.091419:0:15928:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789265421.091423:0:15928:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a101b597c00, rc 0) 00000100:00100000:1.0:1789265421.091505:0:15928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1016d47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0402ccd4-bc8e-4a9b-ad20-843e6e477335+7:13871:x1876180397569920:12345-192.168.203.37@tcp:101:mkdir.0 Request processed in 733us (979us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265421.091524:0:15928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 14 00000040:00080000:1.0:1789265421.106758:0:14336:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789265421.747241:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265422.771449:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265423.154612:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1016d45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:3316:1876180414334976:0@lo:400:kworker.0 00000100:00100000:0.0:1789265423.154719:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265423.154784:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1009072680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1876180414335488:0@lo:400:kworker.0 00000100:00100000:0.0:1789265423.154821:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265423.154855:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789265423.154861:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1009070e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876180414335360:0@lo:400:kworker.0 00000100:00100000:0.0:1789265423.154885:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265423.154920:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1016d44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414335104:0@lo:400:kworker.0 00000100:00100000:0.0:1789265423.154961:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265423.154980:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1009073b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1876180414335616:0@lo:400:kworker.0 00000100:00100000:0.0:1789265423.155018:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265423.155036:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789265423.155041:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1009070380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414335232:0@lo:400:kworker.0 00000100:00100000:0.0:1789265423.155061:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265423.155116:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414335488 00000100:00100000:0.0:1789265423.155125:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414335488 00000100:00100000:0.0:1789265423.155191:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414335360 00000100:00100000:0.0:1789265423.155194:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414335360 00000100:00100000:0.0:1789265423.155208:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414335616 00000100:00100000:0.0:1789265423.155210:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414335616 00000100:00100000:0.0:1789265423.155229:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789265423.155239:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1009072a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1876180414335488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265423.155311:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1009072a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1876180414335488:12345-0@lo:400:kworker.0 Request processed in 72us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265423.155337:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789265423.155358:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789265423.155364:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1009071f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876180414335360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265423.155389:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789265423.155394:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1009071f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876180414335360:12345-0@lo:400:kworker.0 Request processed in 31us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265423.155398:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1009073800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1876180414335616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265423.155400:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789265423.155419:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414335104 00000100:00100000:0.0:1789265423.155423:0:14987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414335104 00000100:00100000:3.0:1789265423.155440:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1009073800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1876180414335616:12345-0@lo:400:kworker.0 Request processed in 44us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265423.155447:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789265423.155452:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414335232 00000100:00100000:0.0:1789265423.155455:0:14987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414335232 00000100:00100000:3.0:1789265423.155468:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414334976 00000100:00100000:0.0:1789265423.155468:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789265423.155471:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414334976 00000100:00100000:0.0:1789265423.155475:0:14987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1009070a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1876180414335104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265423.155498:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789265423.155505:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1007177c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+19:3316:x1876180414334976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265423.155507:0:14987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1009070a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1876180414335104:12345-0@lo:400:kworker.0 Request processed in 33us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265423.155513:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789265423.155524:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789265423.155529:0:14987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1009071c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1876180414335232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265423.155533:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1007177c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+19:3316:x1876180414334976:12345-0@lo:400:kworker.0 Request processed in 29us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265423.155539:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789265423.155554:0:14987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1009071c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1876180414335232:12345-0@lo:400:kworker.0 Request processed in 25us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265423.155560:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1789265423.155577:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789265423.155581:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789265423.155583:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265423.155597:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1009070380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414335232:0@lo:400:kworker.0 00000100:00100000:0.0:1789265423.155603:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1009070e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876180414335360:0@lo:400:kworker.0 00000100:00100000:3.0:1789265423.155608:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1016d44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414335104:0@lo:400:kworker.0 00000100:00100000:0.0:1789265423.155612:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1016d45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:3316:1876180414334976:0@lo:400:kworker.0 00000100:00100000:0.0:1789265423.155622:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1009072680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1876180414335488:0@lo:400:kworker.0 00000100:00100000:3.0:1789265423.155630:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1009073b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1876180414335616:0@lo:400:kworker.0 00000100:00100000:0.0:1789265423.159176:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1009072680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414335744:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789265423.159532:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265423.160841:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414335744 00000100:00100000:3.0:1789265423.160859:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414335744 00000100:00100000:3.0:1789265423.160942:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789265423.160967:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1009070e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876180414335744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789265423.161121:0:14991:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789265423.161227:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1009070e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876180414335744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 263us (1696us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265423.161236:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789265423.161651:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1009072680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414335744:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1789265423.225964:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0402ccd4-bc8e-4a9b-ad20-843e6e477335 00000001:00100000:1.0:1789265423.225989:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a1015321-b6f2-4e27-98e4-70a40da05f32 00000001:00100000:0.0:1789265423.232243:0:5863:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0402ccd4-bc8e-4a9b-ad20-843e6e477335 00000001:00100000:0.0:1789265423.232264:0:5863:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a1015321-b6f2-4e27-98e4-70a40da05f32 00010000:00010000:2.0:1789265423.794798:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789265423.802633:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0402ccd4-bc8e-4a9b-ad20-843e6e477335 00000001:02000400:2.0:1789265424.108427:0:16276:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1789265424.818265:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265425.203363:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02df7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414335872:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789265425.203475:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265425.206372:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414335872 00000100:00100000:1.0:1789265425.206393:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414335872 00000100:00100000:1.0:1789265425.206497:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789265425.206510:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102eecdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414335872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789265425.206560:0:14991:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789265425.206675:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102eecdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414335872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 168us (3200us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265425.206683:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789265425.208094:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02df7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414335872:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789265425.208259:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789265425.842719:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265426.180432:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265426.180488:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397570048 00000100:00100000:0.0:1789265426.180502:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397570048 00000100:00100000:0.0:1789265426.180585:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 104 00000100:00100000:0.0:1789265426.180598:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1007174c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+13:2348:x1876180397570048:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789265426.180706:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1007174c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+13:2348:x1876180397570048:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 110us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265426.180714:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 104 00000100:00100000:0.0:1789265426.180775:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265426.180926:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265426.180950:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265426.180969:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265426.180988:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265426.181012:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265426.181030:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397570304 00000100:00100000:0.0:1789265426.181034:0:14987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397570304 00000100:00100000:0.0:1789265426.181072:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397570816 00000100:00100000:0.0:1789265426.181102:0:14987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397570816 00000100:00100000:0.0:1789265426.181125:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397570432 00000100:00100000:0.0:1789265426.181128:0:14987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397570432 00000100:00100000:0.0:1789265426.181141:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397570688 00000100:00100000:0.0:1789265426.181143:0:14987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397570688 00000100:00100000:0.0:1789265426.181156:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 8 00000100:00100000:0.0:1789265426.181182:0:14987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1009070000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1015321-b6f2-4e27-98e4-70a40da05f32+5:2348:x1876180397570304:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789265426.181233:0:14987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1009070000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1015321-b6f2-4e27-98e4-70a40da05f32+5:2348:x1876180397570304:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 51us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265426.181240:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 8 00000100:00100000:0.0:1789265426.181255:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 9 00000100:00100000:0.0:1789265426.181260:0:14987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1009073480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0402ccd4-bc8e-4a9b-ad20-843e6e477335+5:2348:x1876180397570816:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789265426.181296:0:14987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1009073480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0402ccd4-bc8e-4a9b-ad20-843e6e477335+5:2348:x1876180397570816:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 36us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265426.181303:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 9 00000100:00100000:0.0:1789265426.181314:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 10 00000100:00100000:0.0:1789265426.181320:0:14987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1009072300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1015321-b6f2-4e27-98e4-70a40da05f32+5:2348:x1876180397570432:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789265426.181343:0:14987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1009072300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1015321-b6f2-4e27-98e4-70a40da05f32+5:2348:x1876180397570432:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 23us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265426.181351:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 10 00000100:00100000:0.0:1789265426.181361:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 11 00000100:00100000:0.0:1789265426.181367:0:14987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1009073100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0402ccd4-bc8e-4a9b-ad20-843e6e477335+5:2348:x1876180397570688:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789265426.181388:0:14987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1009073100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0402ccd4-bc8e-4a9b-ad20-843e6e477335+5:2348:x1876180397570688:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 22us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265426.181395:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 11 00000100:00100000:0.0:1789265426.181415:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397570560 00000100:00100000:0.0:1789265426.181419:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397570560 00000100:00100000:0.0:1789265426.181446:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397570176 00000100:00100000:0.0:1789265426.181448:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397570176 00000100:00100000:0.0:1789265426.181466:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 20 00000100:00100000:0.0:1789265426.181481:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1009071880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0402ccd4-bc8e-4a9b-ad20-843e6e477335+6:2348:x1876180397570560:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789265426.181526:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1009071880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0402ccd4-bc8e-4a9b-ad20-843e6e477335+6:2348:x1876180397570560:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 45us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265426.181533:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 20 00000100:00100000:0.0:1789265426.181546:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 21 00000100:00100000:0.0:1789265426.181552:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1009070700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1015321-b6f2-4e27-98e4-70a40da05f32+6:2348:x1876180397570176:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789265426.181576:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1009070700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1015321-b6f2-4e27-98e4-70a40da05f32+6:2348:x1876180397570176:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 25us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265426.181582:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 21 00000100:00080000:0.0:1789265426.181606:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789265426.181612:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789265426.181614:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789265426.866516:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789265427.686699:0:16424:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdfde6caa0 20000000:00000080:2.0:1789265427.686713:0:16424:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8a0f0196b800 uarg=0000000000000000 20000000:01000000:2.0:1789265427.686746:0:16424:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789265427.686752:0:16424:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789265427.686756:0:16424:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1789265427.688048:0:16425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1789265427.689319:0:16424:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789265427.699328:0:16424:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789265427.699363:0:16424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a102e537800/0x27274ba5bb9532b4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265427.699382:0:16424:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a103fad6400/0x27274ba5bb952fab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb952fa4 expref: 18 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265427.699390:0:16424:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a103fae9000/0x27274ba5bb952ff8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb952ff1 expref: 18 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265427.699397:0:16424:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a103fa35000/0x27274ba5bb953133 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb95312c expref: 18 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265427.699406:0:16424:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a102e536000/0x27274ba5bb953252 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f01b7 expref: 12 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265427.699413:0:16424:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a102e537400/0x27274ba5bb95328a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0219 expref: 12 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265427.699421:0:16424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a102e537800/0x27274ba5bb9532b4 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265427.699461:0:16424:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a102e537400/0x27274ba5bb95328a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0219 expref: 12 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265427.699494:0:16424:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a102e537400/0x27274ba5bb95328a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0219 expref: 12 pid: 14297 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265427.699515:0:16424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102eecd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16424:1876180414336000:192.168.203.37@tcp:104: 00010000:00010000:2.0:1789265427.701929:0:16424:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a102e536000/0x27274ba5bb953252 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f01b7 expref: 12 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265427.701948:0:16424:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a102e536000/0x27274ba5bb953252 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f01b7 expref: 12 pid: 14297 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265427.701962:0:16424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102eece680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16424:1876180414336128:192.168.203.37@tcp:104: 00010000:00010000:2.0:1789265427.702044:0:16424:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a103fa35000/0x27274ba5bb953133 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27274ba5bb95312c expref: 18 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265427.702053:0:16424:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a103fa35000/0x27274ba5bb953133 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27274ba5bb95312c expref: 18 pid: 14299 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265427.702062:0:16424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102eecc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16424:1876180414336256:0@lo:104: 00000100:00100000:2.0:1789265427.702116:0:16424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789265427.702146:0:16424:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a103fae9000/0x27274ba5bb952ff8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27274ba5bb952ff1 expref: 18 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265427.702154:0:16424:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a103fae9000/0x27274ba5bb952ff8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27274ba5bb952ff1 expref: 18 pid: 14297 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265427.702162:0:16424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102eece300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16424:1876180414336384:0@lo:104: 00000100:00100000:2.0:1789265427.702181:0:16424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265427.702233:0:14287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414336256 00000100:00100000:2.0:1789265427.702241:0:14287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414336256 00000100:00100000:1.0:1789265427.702282:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414336384 00000100:00100000:1.0:1789265427.702287:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414336384 00000100:00100000:1.0:1789265427.702326:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789265427.702334:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102eeced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+4:16424:x1876180414336384:12345-0@lo:104: 00010000:00010000:1.0:1789265427.702346:0:14288:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff8a103fad7400/0x27274ba5bb952ff1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x27274ba5bb952ff8 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265427.702396:0:14288:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789265427.702401:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102eeced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+4:16424:x1876180414336384:12345-0@lo:104: Request processed in 69us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265427.702408:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1789265427.702435:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265427.702441:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff8a103fad7400/0x27274ba5bb952ff1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x27274ba5bb952ff8 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265427.702449:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad7400 already unused, calling callback (ffffffffc1ba2c20) 10000000:00010000:1.0:1789265427.702453:0:14293:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff8a103fad7400/0x27274ba5bb952ff1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x27274ba5bb952ff8 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265427.702462:0:14293:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff8a103fad7400/0x27274ba5bb952ff1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x27274ba5bb952ff8 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265427.702469:0:14293:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff8a103fad7400/0x27274ba5bb952ff1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x27274ba5bb952ff8 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265427.702475:0:14293:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789265427.702503:0:14293:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff8a103fad7400/0x27274ba5bb952ff1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb952ff8 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265427.702510:0:14293:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789265427.702543:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff8a103fad7400/0x27274ba5bb952ff1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb952ff8 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265427.702551:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff8a103fad7400/0x27274ba5bb952ff1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb952ff8 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265427.702563:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265427.702566:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265427.702567:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265427.702585:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02df7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:3316:1876180414336512:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789265427.702614:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265427.702658:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414336512 00000100:00100000:1.0:1789265427.702662:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414336512 00010000:00010000:1.0:1789265427.702679:0:14289:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a103fae9000/0x27274ba5bb952ff8 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27274ba5bb952ff1 expref: 19 pid: 14297 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265427.702698:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789265427.702703:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02e30a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+19:3316:x1876180414336512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789265427.702712:0:14289:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265427.702717:0:14289:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a103fae9000/0x27274ba5bb952ff8 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27274ba5bb952ff1 expref: 19 pid: 14297 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265427.702725:0:14289:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a103fae9000/0x27274ba5bb952ff8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27274ba5bb952ff1 expref: 19 pid: 14297 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265427.702740:0:14289:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265427.702765:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02e30a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+19:3316:x1876180414336512:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265427.702771:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789265427.702803:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02df7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:3316:1876180414336512:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789265427.702860:0:16424:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a103fad6400/0x27274ba5bb952fab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27274ba5bb952fa4 expref: 18 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265427.702868:0:16424:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a103fad6400/0x27274ba5bb952fab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27274ba5bb952fa4 expref: 18 pid: 14297 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265427.702877:0:16424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02e32d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16424:1876180414336640:0@lo:104: 00000100:00100000:1.0:1789265427.702901:0:16424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265427.702926:0:14288:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789265427.702935:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414336640 00000100:00100000:1.0:1789265427.702943:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414336640 00000100:00100000:1.0:1789265427.702960:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789265427.702966:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102ecf8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+4:16424:x1876180414336640:12345-0@lo:104: 00010000:00010000:1.0:1789265427.702974:0:14288:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff8a103fad7e00/0x27274ba5bb952fa4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x27274ba5bb952fab expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265427.703006:0:14288:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789265427.703011:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102ecf8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+4:16424:x1876180414336640:12345-0@lo:104: Request processed in 46us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265427.703016:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1789265427.703031:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265427.703036:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff8a103fad7e00/0x27274ba5bb952fa4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x27274ba5bb952fab expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265427.703042:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fad7e00 already unused, calling callback (ffffffffc1ba2c20) 10000000:00010000:1.0:1789265427.703045:0:14292:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff8a103fad7e00/0x27274ba5bb952fa4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x27274ba5bb952fab expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265427.703052:0:14292:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff8a103fad7e00/0x27274ba5bb952fa4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x27274ba5bb952fab expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265427.703059:0:14292:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff8a103fad7e00/0x27274ba5bb952fa4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x27274ba5bb952fab expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265427.703064:0:14292:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789265427.703110:0:14292:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff8a103fad7e00/0x27274ba5bb952fa4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb952fab expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265427.703117:0:14292:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789265427.703132:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff8a103fad7e00/0x27274ba5bb952fa4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb952fab expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265427.703145:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff8a103fad7e00/0x27274ba5bb952fa4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb952fab expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265427.703153:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265427.703155:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265427.703156:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265427.703170:0:16424:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a102eb77300 going to sleep for 11 seconds 00010000:00010000:1.0:1789265427.703184:0:16424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a103fae9000/0x27274ba5bb952ff8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27274ba5bb952ff1 expref: 18 pid: 14297 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265427.703194:0:16424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102eece300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16424:1876180414336384:0@lo:104: 00000100:00100000:1.0:1789265427.703208:0:16424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02e32d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16424:1876180414336640:0@lo:104: 00000100:00100000:1.0:1789265427.703231:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02e31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:3317:1876180414336768:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789265427.703265:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265427.703361:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414336768 00000100:00100000:1.0:1789265427.703365:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414336768 00010000:00010000:1.0:1789265427.703379:0:14290:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a103fad6400/0x27274ba5bb952fab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27274ba5bb952fa4 expref: 18 pid: 14297 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265427.703398:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789265427.703403:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02e33800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+18:3317:x1876180414336768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789265427.703411:0:14290:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265427.703414:0:14290:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a103fad6400/0x27274ba5bb952fab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27274ba5bb952fa4 expref: 18 pid: 14297 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265427.703422:0:14290:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a103fad6400/0x27274ba5bb952fab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27274ba5bb952fa4 expref: 18 pid: 14297 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265427.703442:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a103fad6400/0x27274ba5bb952fab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27274ba5bb952fa4 expref: 18 pid: 14297 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265427.703452:0:14290:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265427.703478:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02e33800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+17:3317:x1876180414336768:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265427.703484:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789265427.703509:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02e31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:3317:1876180414336768:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789265427.704955:0:14287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789265427.704970:0:14287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102eecca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+3:16424:x1876180414336256:12345-0@lo:104: 00010000:00010000:2.0:1789265427.704986:0:14287:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff8a101b596800/0x27274ba5bb95312c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27274ba5bb953133 expref: -99 pid: 15707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265427.705092:0:14287:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789265427.705099:0:14287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102eecca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+3:16424:x1876180414336256:12345-0@lo:104: Request processed in 134us (2983us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265427.705106:0:14287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789265427.705151:0:16424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102eecc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16424:1876180414336256:0@lo:104: 00010000:00010000:2.0:1789265427.705159:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265427.705166:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff8a101b596800/0x27274ba5bb95312c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27274ba5bb953133 expref: -99 pid: 15707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265427.705174:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b596800 already unused, calling callback (ffffffffc1ba2c20) 10000000:00010000:2.0:1789265427.705178:0:14293:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff8a101b596800/0x27274ba5bb95312c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x27274ba5bb953133 expref: -99 pid: 15707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265427.705186:0:14293:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff8a101b596800/0x27274ba5bb95312c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x27274ba5bb953133 expref: -99 pid: 15707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265427.705193:0:14293:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff8a101b596800/0x27274ba5bb95312c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x27274ba5bb953133 expref: -99 pid: 15707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265427.705200:0:14293:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789265427.705239:0:14293:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff8a101b596800/0x27274ba5bb95312c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb953133 expref: -99 pid: 15707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265427.705246:0:14293:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265427.705295:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff8a101b596800/0x27274ba5bb95312c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb953133 expref: -99 pid: 15707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265427.705303:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff8a101b596800/0x27274ba5bb95312c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27274ba5bb953133 expref: -99 pid: 15707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265427.705319:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265427.705320:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265427.705322:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265427.705381:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789265427.705395:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102eeced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:3317:1876180414336896:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789265427.705436:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265427.705515:0:14291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414336896 00000100:00100000:2.0:1789265427.705522:0:14291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414336896 00010000:00010000:2.0:1789265427.705552:0:14291:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a103fa35000/0x27274ba5bb953133 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27274ba5bb95312c expref: 17 pid: 14299 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265427.705581:0:14291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789265427.705587:0:14291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a104163c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+17:3317:x1876180414336896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789265427.705597:0:14291:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265427.705602:0:14291:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a103fa35000/0x27274ba5bb953133 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27274ba5bb95312c expref: 17 pid: 14299 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265427.705611:0:14291:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a103fa35000/0x27274ba5bb953133 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27274ba5bb95312c expref: 17 pid: 14299 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265427.705624:0:14291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a103fa35000/0x27274ba5bb953133 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27274ba5bb95312c expref: 17 pid: 14299 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265427.705636:0:14291:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265427.705665:0:14291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a104163c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+16:3317:x1876180414336896:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265427.705672:0:14291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789265427.705715:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102eeced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:3317:1876180414336896:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789265427.707429:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265427.707511:0:16424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102eecd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16424:1876180414336000:192.168.203.37@tcp:104: 00000100:00100000:3.0:1789265427.707630:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397570944 00000100:00100000:3.0:1789265427.707637:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397570944 00010000:00010000:3.0:1789265427.707667:0:14289:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a102e537400/0x27274ba5bb95328a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0219 expref: 13 pid: 14297 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265427.707713:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 7 00000100:00100000:3.0:1789265427.707723:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02e31880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+13:2350:x1876180397570944:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265427.707736:0:14289:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265427.707742:0:14289:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a102e537400/0x27274ba5bb95328a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0219 expref: 13 pid: 14297 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265427.707756:0:14289:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a102e537400/0x27274ba5bb95328a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0219 expref: 13 pid: 14297 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265427.707773:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a102e537400/0x27274ba5bb95328a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0219 expref: 13 pid: 14297 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265427.707909:0:14289:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265427.707959:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02e31880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+12:2350:x1876180397570944:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 237us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265427.707967:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 7 00000100:00100000:1.0:1789265427.710590:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265427.711347:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397571072 00000100:00100000:2.0:1789265427.711357:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397571072 00010000:00010000:2.0:1789265427.711395:0:14290:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a102e536000/0x27274ba5bb953252 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f01b7 expref: 12 pid: 14297 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265427.711434:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 8 00000100:00100000:2.0:1789265427.711444:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02e31500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+12:2351:x1876180397571072:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265427.711458:0:14290:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265427.711464:0:14290:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a102e536000/0x27274ba5bb953252 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f01b7 expref: 12 pid: 14297 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265427.711479:0:14290:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a102e536000/0x27274ba5bb953252 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f01b7 expref: 12 pid: 14297 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265427.711499:0:14290:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a102e537800/0x27274ba5bb9532b4 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265427.711509:0:14290:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a102e537800/0x27274ba5bb9532b4 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265427.711524:0:14290:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a102e537800/0x27274ba5bb9532b4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265427.711532:0:14290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a102e537800/0x27274ba5bb9532b4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265427.711539:0:14290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a102e537800/0x27274ba5bb9532b4 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265427.711546:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a102e537800/0x27274ba5bb9532b4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265427.711562:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a102e537800 already unused, calling callback (ffffffffc1581350) 00010000:00010000:2.0:1789265427.711566:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a102e537800/0x27274ba5bb9532b4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265427.711575:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a102e537800/0x27274ba5bb9532b4 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265427.711584:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a102e537800/0x27274ba5bb9532b4 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265427.711594:0:14290:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265427.711651:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02e31500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+12:2351:x1876180397571072:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 208us (1079us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265427.711660:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 8 00010000:00010000:0.0:1789265427.711833:0:16424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a102e536000/0x27274ba5bb953252 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f01b7 expref: 11 pid: 14297 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265427.711847:0:16424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102eece680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16424:1876180414336128:192.168.203.37@tcp:104: 00010000:00010000:0.0:1789265427.711876:0:16424:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a102e537800/0x27274ba5bb9532b4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265427.711885:0:16424:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a102e537800/0x27274ba5bb9532b4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265427.711898:0:16424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a102e537800/0x27274ba5bb9532b4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265427.711903:0:16424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a102e537800/0x27274ba5bb9532b4 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265427.891333:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265428.276549:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02e32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:3315:1876180414337024:0@lo:400:kworker.0 00000100:00100000:1.0:1789265428.276691:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265428.276742:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02e30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1876180414337536:0@lo:400:kworker.0 00000100:00100000:0.0:1789265428.276757:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414337024 00000100:00100000:0.0:1789265428.276766:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414337024 00000100:00100000:1.0:1789265428.276772:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265428.276798:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789265428.276805:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02e32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414337152:0@lo:400:kworker.0 00000100:00100000:1.0:1789265428.276834:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265428.276838:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789265428.276851:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1007175450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+16:3315:x1876180414337024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265428.276901:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1007175450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+16:3315:x1876180414337024:12345-0@lo:400:kworker.0 Request processed in 53us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265428.276909:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789265428.276959:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414337536 00000100:00100000:0.0:1789265428.276962:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414337536 00000100:00100000:0.0:1789265428.276997:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789265428.277004:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02e33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876180414337536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265428.277035:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02e33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876180414337536:12345-0@lo:400:kworker.0 Request processed in 32us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265428.277042:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789265428.277052:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02e33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1876180414337664:0@lo:400:kworker.0 00000100:00100000:0.0:1789265428.277094:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414337152 00000100:00100000:0.0:1789265428.277098:0:14987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414337152 00000100:00100000:0.0:1789265428.277126:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789265428.277133:0:14987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02e30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414337152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265428.277438:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265428.277446:0:14987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02e30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876180414337152:12345-0@lo:400:kworker.0 Request processed in 312us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265428.277455:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789265428.277479:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02e32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:3315:1876180414337024:0@lo:400:kworker.0 00000100:00080000:0.0:1789265428.277489:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789265428.277496:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265428.277499:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02e30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1876180414337536:0@lo:400:kworker.0 00000100:00100000:0.0:1789265428.277522:0:15928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414337664 00000100:00100000:0.0:1789265428.277527:0:15928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414337664 00000100:00100000:1.0:1789265428.277547:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02e32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1876180414337152:0@lo:400:kworker.0 00000100:00100000:0.0:1789265428.277562:0:15928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789265428.277568:0:15928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02df7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876180414337664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265428.277579:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02e31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876180414337408:0@lo:400:kworker.0 00000100:00100000:0.0:1789265428.277597:0:15928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02df7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876180414337664:12345-0@lo:400:kworker.0 Request processed in 30us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265428.277630:0:15928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789265428.277684:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789265428.277687:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265428.277708:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414337408 00000100:00100000:1.0:1789265428.277711:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789265428.277712:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414337408 00000100:00100000:1.0:1789265428.277720:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02e30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414337280:0@lo:400:kworker.0 00000100:00100000:1.0:1789265428.277752:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265428.277756:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789265428.277766:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02e32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876180414337408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265428.277775:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1009072d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414337792:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789265428.277815:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02e32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876180414337408:12345-0@lo:400:kworker.0 Request processed in 49us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265428.277816:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265428.277826:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789265428.277848:0:14989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414337280 00000100:00100000:0.0:1789265428.277852:0:14989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414337280 00000100:00100000:0.0:1789265428.277878:0:14989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789265428.277883:0:14989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02e30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1876180414337280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265428.277913:0:14989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02e30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1876180414337280:12345-0@lo:400:kworker.0 Request processed in 29us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265428.277920:0:14989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1789265428.277936:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789265428.278041:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02e31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876180414337408:0@lo:400:kworker.0 00000100:00100000:1.0:1789265428.278060:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02e30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414337280:0@lo:400:kworker.0 00000100:00100000:0.0:1789265428.278243:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02e33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1876180414337664:0@lo:400:kworker.0 00000100:00100000:0.0:1789265428.278307:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414337792 00000100:00100000:0.0:1789265428.278311:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414337792 00000100:00100000:0.0:1789265428.278343:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789265428.278349:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02e32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876180414337792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789265428.278374:0:14991:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789265428.278428:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02e32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876180414337792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265428.278435:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789265428.278517:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1009072d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414337792:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789265428.914574:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265429.552286:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265429.552426:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397571200 00000100:00100000:0.0:1789265429.552437:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397571200 00000100:00100000:0.0:1789265429.552490:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 106 00000100:00100000:0.0:1789265429.552501:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1007175c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+11:13727:x1876180397571200:12345-192.168.203.37@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789265429.552518:0:14299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265429.552537:0:14299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a103fa34c00/0x27274ba5bb9532bb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x73b61075d99f024a expref: -99 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265429.552570:0:14299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a103fa34c00/0x27274ba5bb9532bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f024a expref: 12 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265429.552592:0:14299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a103fa34c00/0x27274ba5bb9532bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f024a expref: 12 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265429.552602:0:14299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fa34c00, rc 0) 00000100:00100000:0.0:1789265429.552667:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1007175c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+12:13727:x1876180397571200:12345-192.168.203.37@tcp:101:ll_cfg_requeue.0 Request processed in 169us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265429.552675:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 106 00000100:00100000:1.0:1789265429.556342:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265429.556428:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397571328 00000100:00100000:0.0:1789265429.556438:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397571328 00000100:00100000:0.0:1789265429.556503:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 107 00000100:00100000:0.0:1789265429.556513:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1007177850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+12:13727:x1876180397571328:12345-192.168.203.37@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789265429.556866:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1007177850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+12:13727:x1876180397571328:12345-192.168.203.37@tcp:501:ll_cfg_requeue.0 Request processed in 354us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265429.556874:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 107 00000100:00100000:0.0:1789265429.561503:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265429.562855:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397571456 00000100:00100000:3.0:1789265429.562867:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397571456 00000100:00100000:3.0:1789265429.562917:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 108 00000100:00100000:3.0:1789265429.562929:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102ec4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+12:13727:x1876180397571456:12345-192.168.203.37@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789265429.563164:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102ec4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+12:13727:x1876180397571456:12345-192.168.203.37@tcp:503:ll_cfg_requeue.0 Request processed in 236us (1670us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265429.563172:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 108 00000100:00100000:3.0:1789265429.571017:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265429.571976:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397571584 00000100:00100000:3.0:1789265429.571988:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397571584 00000100:00100000:3.0:1789265429.572040:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 109 00000100:00100000:3.0:1789265429.572050:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102ec4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+12:13727:x1876180397571584:12345-192.168.203.37@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265429.572066:0:14299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265429.572104:0:14299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a0f03143600/0x27274ba5bb9532c2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x73b61075d99f0251 expref: -99 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265429.572187:0:14299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a0f03143600/0x27274ba5bb9532c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0251 expref: 13 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265429.572200:0:14299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a0f03143600/0x27274ba5bb9532c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0251 expref: 13 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265429.572219:0:14299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a0f03143600, rc 0) 00000100:00100000:3.0:1789265429.572290:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102ec4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+13:13727:x1876180397571584:12345-192.168.203.37@tcp:101:ll_cfg_requeue.0 Request processed in 242us (1280us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265429.572298:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 109 00000100:00100000:3.0:1789265429.580774:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265429.580828:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397571712 00000100:00100000:1.0:1789265429.580840:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397571712 00000100:00100000:1.0:1789265429.580898:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 110 00000100:00100000:1.0:1789265429.580908:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102ec4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+13:13727:x1876180397571712:12345-192.168.203.37@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265429.581198:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102ec4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+13:13727:x1876180397571712:12345-192.168.203.37@tcp:501:ll_cfg_requeue.0 Request processed in 290us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265429.581208:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 110 00000100:00100000:3.0:1789265429.588571:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265429.588743:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397571840 00000100:00100000:1.0:1789265429.588754:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397571840 00000100:00100000:1.0:1789265429.588821:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 111 00000100:00100000:1.0:1789265429.588834:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102ec4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+13:13727:x1876180397571840:12345-192.168.203.37@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789265429.589044:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102ec4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+13:13727:x1876180397571840:12345-192.168.203.37@tcp:503:ll_cfg_requeue.0 Request processed in 212us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265429.589053:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 111 10000000:01000000:1.0:1789265429.686549:0:14301:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789265429.686564:0:14301:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a1003113800 from 10 10000000:01000000:1.0:1789265429.686570:0:14301:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789265429.686612:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a101b597e00/0x27274ba5bb9532c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265429.686625:0:14301:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff8a101b597e00/0x27274ba5bb9532c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265429.686638:0:14301:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff8a101b597e00/0x27274ba5bb9532c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265429.686664:0:14301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02e30380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14301:1876180414337920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789265429.686735:0:14301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265429.686794:0:14301:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1003018e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789265429.688129:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414337920 00000100:00100000:3.0:1789265429.688141:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414337920 00000100:00100000:3.0:1789265429.688257:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789265429.688267:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102ec4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+16:14301:x1876180414337920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265429.688284:0:14299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265429.688301:0:14299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a0f03142400/0x27274ba5bb9532d0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x27274ba5bb9532c9 expref: -99 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265429.688342:0:14299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a0f03142400/0x27274ba5bb9532d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27274ba5bb9532c9 expref: 17 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265429.688354:0:14299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a0f03142400/0x27274ba5bb9532d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb9532c9 expref: 17 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265429.688363:0:14299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a0f03142400, rc 0) 00000100:00100000:3.0:1789265429.688428:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102ec4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+17:14301:x1876180414337920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (1693us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265429.688434:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789265429.689514:0:14301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02e30380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14301:1876180414337920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789265429.689803:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff8a101b597e00/0x27274ba5bb9532c9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb9532d0 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265429.689818:0:14301:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff8a101b597e00/0x27274ba5bb9532c9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27274ba5bb9532d0 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265429.690025:0:14301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02e30380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14301:1876180414338048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265429.690116:0:14301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265429.696287:0:14301:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1003018e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789265429.699933:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414338048 00000100:00100000:2.0:1789265429.699949:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414338048 00000100:00100000:1.0:1789265429.700333:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789265429.700344:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102ec4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+17:14301:x1876180414338048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265429.700642:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102ec4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+17:14301:x1876180414338048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 299us (10526us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265429.700661:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789265429.700712:0:14301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02e30380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14301:1876180414338048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265429.700763:0:14301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02e30380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14301:1876180414338176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789265429.700814:0:14301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265429.700843:0:14301:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1003018e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789265429.700855:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414338176 00000100:00100000:1.0:1789265429.700859:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414338176 00000100:00100000:1.0:1789265429.700877:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789265429.700882:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102ec4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+17:14301:x1876180414338176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789265429.701015:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102ec4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+17:14301:x1876180414338176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 132us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265429.701022:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789265429.701061:0:14301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02e30380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14301:1876180414338176:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789265429.701747:0:16505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1789265429.701794:0:14301:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1789265429.701811:0:14301:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789265429.701821:0:14301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a101b597e00/0x27274ba5bb9532c9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb9532d0 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265429.701832:0:14301:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff8a101b597e00/0x27274ba5bb9532c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb9532d0 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265429.701843:0:14301:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789265429.701845:0:14301:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a103fbb2800 from 10 10000000:01000000:1.0:1789265429.701848:0:14301:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789265429.701875:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a101b596e00/0x27274ba5bb9532d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265429.701893:0:14301:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff8a101b596e00/0x27274ba5bb9532d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265429.701903:0:14301:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff8a101b596e00/0x27274ba5bb9532d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265429.701919:0:14301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02e30380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14301:1876180414338304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789265429.701958:0:14301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265429.701977:0:14301:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1007113240 going to sleep for 11 seconds 00000100:00100000:1.0:1789265429.701993:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414338304 00000100:00100000:1.0:1789265429.701998:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414338304 00000100:00100000:1.0:1789265429.702020:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789265429.702027:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102ec4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+17:14301:x1876180414338304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789265429.702037:0:14298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265429.702050:0:14298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a101b596600/0x27274ba5bb9532de lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x27274ba5bb9532d7 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265429.702072:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a101b596600/0x27274ba5bb9532de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27274ba5bb9532d7 expref: 18 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265429.702107:0:14298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a101b596600/0x27274ba5bb9532de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb9532d7 expref: 18 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265429.702115:0:14298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a101b596600, rc 0) 00000100:00100000:1.0:1789265429.702149:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102ec4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+18:14301:x1876180414338304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265429.702155:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789265429.702197:0:14301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02e30380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14301:1876180414338304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789265429.702210:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff8a101b596e00/0x27274ba5bb9532d7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb9532de expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265429.702219:0:14301:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff8a101b596e00/0x27274ba5bb9532d7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x27274ba5bb9532de expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265429.702270:0:14301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02e30380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14301:1876180414338432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265429.702296:0:14301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265429.702311:0:14301:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1007113240 going to sleep for 11 seconds 00000100:00100000:1.0:1789265429.702323:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414338432 00000100:00100000:1.0:1789265429.702326:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414338432 00000100:00100000:1.0:1789265429.702342:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789265429.702349:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102ec4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+18:14301:x1876180414338432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265429.702543:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102ec4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+18:14301:x1876180414338432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 194us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265429.702550:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789265429.702578:0:14301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02e30380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14301:1876180414338432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265429.702601:0:14301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02e30380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14301:1876180414338560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789265429.702636:0:14301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265429.702649:0:14301:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a101878f600 going to sleep for 11 seconds 00000100:00100000:1.0:1789265429.702660:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414338560 00000100:00100000:1.0:1789265429.702663:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414338560 00000100:00100000:1.0:1789265429.702680:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789265429.702686:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102ec4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+18:14301:x1876180414338560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789265429.702808:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102ec4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+18:14301:x1876180414338560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 121us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265429.702820:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789265429.702858:0:14301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02e30380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14301:1876180414338560:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789265429.713739:0:16506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1789265429.714313:0:14301:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1789265429.714338:0:14301:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789265429.714350:0:14301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a101b596e00/0x27274ba5bb9532d7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb9532de expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265429.714632:0:14301:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff8a101b596e00/0x27274ba5bb9532d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb9532de expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265429.714644:0:14301:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789265429.714646:0:14301:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a102eccb800 from 10 10000000:01000000:0.0:1789265429.714649:0:14301:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789265429.714695:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a103fa35e00/0x27274ba5bb9532e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265429.714703:0:14301:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff8a103fa35e00/0x27274ba5bb9532e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265429.714723:0:14301:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff8a103fa35e00/0x27274ba5bb9532e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265429.714748:0:14301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1009072d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14301:1876180414338688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789265429.714816:0:14301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265429.715003:0:14301:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10012540c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265429.715379:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414338688 00000100:00100000:1.0:1789265429.715388:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414338688 00000100:00100000:1.0:1789265429.715444:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789265429.715454:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102ec4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+18:14301:x1876180414338688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789265429.715466:0:14298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265429.715480:0:14298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a101b597400/0x27274ba5bb9532ec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x27274ba5bb9532e5 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265429.715505:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a101b597400/0x27274ba5bb9532ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27274ba5bb9532e5 expref: 19 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265429.715516:0:14298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a101b597400/0x27274ba5bb9532ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27274ba5bb9532e5 expref: 19 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265429.715524:0:14298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a101b597400, rc 0) 00000100:00100000:1.0:1789265429.715569:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102ec4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+19:14301:x1876180414338688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265429.715576:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789265429.715937:0:14301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1009072d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14301:1876180414338688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265429.715960:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff8a103fa35e00/0x27274ba5bb9532e5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb9532ec expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265429.715977:0:14301:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff8a103fa35e00/0x27274ba5bb9532e5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x27274ba5bb9532ec expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265429.716046:0:14301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103ba79c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14301:1876180414338816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265429.716110:0:14301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265429.716139:0:14301:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1008f5c600 going to sleep for 11 seconds 00000100:00100000:2.0:1789265429.718299:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414338816 00000100:00100000:2.0:1789265429.718316:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414338816 00000100:00100000:2.0:1789265429.718381:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789265429.718392:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102ec4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+19:14301:x1876180414338816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265429.718685:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102ec4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+19:14301:x1876180414338816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 294us (2573us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265429.718693:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789265429.718737:0:14301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103ba79c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14301:1876180414338816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265429.718789:0:14301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102eeced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14301:1876180414338944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265429.718842:0:14301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265429.718864:0:14301:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a0f02db6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789265429.718883:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414338944 00000100:00100000:2.0:1789265429.718887:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414338944 00000100:00100000:2.0:1789265429.718904:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789265429.718910:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102ec4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+19:14301:x1876180414338944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265429.719050:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102ec4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+19:14301:x1876180414338944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 139us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265429.719057:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789265429.719122:0:14301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102eeced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:14301:1876180414338944:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789265429.719757:0:16509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1789265429.719813:0:14301:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1789265429.719831:0:14301:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789265429.719841:0:14301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff8a103fa35e00/0x27274ba5bb9532e5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb9532ec expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265429.719851:0:14301:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff8a103fa35e00/0x27274ba5bb9532e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27274ba5bb9532ec expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265429.944546:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265430.322403:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02e30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414339072:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789265430.322474:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265430.322639:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414339072 00000100:00100000:1.0:1789265430.322647:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414339072 00000100:00100000:1.0:1789265430.322711:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789265430.322721:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1009071180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876180414339072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789265430.322754:0:14991:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789265430.322816:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1009071180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876180414339072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (341us total) trans 0 rc 0/0 00000100:00080000:0.0:1789265430.322913:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789265430.322983:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02e30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1876180414339072:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789265430.323036:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1789265430.963188:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265431.238275:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265431.240638:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397571968 00000100:00100000:0.0:1789265431.240654:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397571968 00000100:00100000:0.0:1789265431.240760:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 15 00000100:00100000:0.0:1789265431.240774:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103ba79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1015321-b6f2-4e27-98e4-70a40da05f32+6:14381:x1876180397571968:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789265431.240794:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265431.240819:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35800/0x27274ba5bb9532f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f0258 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265431.240879:0:14305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34800/0x27274ba5bb9532fa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265431.240894:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34800/0x27274ba5bb9532fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265431.240908:0:14305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34800/0x27274ba5bb9532fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265431.240922:0:14305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35000/0x27274ba5bb953301 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265431.240929:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35000/0x27274ba5bb953301 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265431.240936:0:14305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35000/0x27274ba5bb953301 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265431.241299:0:14305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34a00/0x27274ba5bb953308 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265431.241320:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34a00/0x27274ba5bb953308 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265431.241328:0:14305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34a00/0x27274ba5bb953308 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265431.241354:0:14305:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789265431.241358:0:14305:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789265431.241391:0:14305:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34a00/0x27274ba5bb953308 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265431.241402:0:14305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34800/0x27274ba5bb9532fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265431.241408:0:14305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34800/0x27274ba5bb9532fa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265431.241414:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34800/0x27274ba5bb9532fa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265431.241419:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fa34800 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789265431.241423:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34800/0x27274ba5bb9532fa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265431.241429:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34800/0x27274ba5bb9532fa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265431.241440:0:14305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a101cdf4f00) 00010000:00010000:0.0:1789265431.241442:0:14305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265431.241446:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34800/0x27274ba5bb9532fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265431.241473:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34800/0x27274ba5bb9532fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265431.241487:0:14305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35000/0x27274ba5bb953301 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265431.241493:0:14305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35000/0x27274ba5bb953301 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265431.241498:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35000/0x27274ba5bb953301 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265431.241503:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fa35000 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789265431.241506:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35000/0x27274ba5bb953301 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265431.241513:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35000/0x27274ba5bb953301 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265431.241520:0:14305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8a1002ca3900) 00010000:00010000:0.0:1789265431.241523:0:14305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265431.241526:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35000/0x27274ba5bb953301 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265431.241532:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35000/0x27274ba5bb953301 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265431.241575:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35800/0x27274ba5bb9532f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0258 expref: 8 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265431.241600:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa34a00/0x27274ba5bb953308 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0258 expref: 7 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265431.241608:0:14305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8a1002ca3e00) 00010000:00010000:0.0:1789265431.241610:0:14305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789265431.241613:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a103fa34a00, rc 0) 00000100:00100000:0.0:1789265431.241687:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103ba79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1015321-b6f2-4e27-98e4-70a40da05f32+7:14381:x1876180397571968:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 917us (3427us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265431.241695:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 15 00000100:00080000:2.0:1789265431.242115:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265431.251645:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265431.257572:0:15928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397572224 00000100:00100000:0.0:1789265431.257598:0:15928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397572224 00000100:00100000:1.0:1789265431.258027:0:15928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 16 00000100:00100000:1.0:1789265431.258048:0:15928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103ba79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1015321-b6f2-4e27-98e4-70a40da05f32+7:14381:x1876180397572224:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789265431.258123:0:15928:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265431.258155:0:15928:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596c00/0x27274ba5bb95330f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f025f expref: -99 pid: 15928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.258264:0:15928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb953316 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.258282:0:15928:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb953316 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.258296:0:15928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb953316 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.258313:0:15928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb95331d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.258320:0:15928:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb95331d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.258326:0:15928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb95331d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.259760:0:15928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb953324 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.259785:0:15928:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb953324 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.260509:0:15928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb953324 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265431.260530:0:15928:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1789265431.261525:0:15928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb953316 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.261542:0:15928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb953316 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.261551:0:15928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb953316 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.261558:0:15928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b597200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789265431.261563:0:15928:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb953316 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.261572:0:15928:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb953316 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.261590:0:15928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8a1002ca3e00) 00010000:00010000:1.0:1789265431.261593:0:15928:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265431.261598:0:15928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb953316 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.261604:0:15928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb953316 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.261621:0:15928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb95331d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.261627:0:15928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb95331d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.261644:0:15928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb95331d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.261649:0:15928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b597a00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789265431.261652:0:15928:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb95331d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.261659:0:15928:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb95331d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.261747:0:15928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8a101cdf4a00) 00010000:00010000:1.0:1789265431.261751:0:15928:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265431.261755:0:15928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb95331d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.261761:0:15928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb95331d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.264609:0:15928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596c00/0x27274ba5bb95330f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f025f expref: 10 pid: 15928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.264644:0:15928:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597800/0x27274ba5bb953324 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f025f expref: 9 pid: 15928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.264656:0:15928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a101cdf4500) 00010000:00010000:1.0:1789265431.264659:0:15928:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265431.264888:0:15928:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a101b597800, rc 0) 00000100:00100000:1.0:1789265431.265298:0:15928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103ba79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1015321-b6f2-4e27-98e4-70a40da05f32+9:14381:x1876180397572224:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 7257us (13663us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1789265431.265324:0:15928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 16 00000100:00100000:3.0:1789265431.274650:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265431.275934:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397572352 00000100:00100000:0.0:1789265431.276187:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397572352 00000100:00100000:2.0:1789265431.276400:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 17 00000100:00100000:2.0:1789265431.276411:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103ba7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1015321-b6f2-4e27-98e4-70a40da05f32+9:14381:x1876180397572352:12345-192.168.203.37@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789265431.276539:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103ba7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1015321-b6f2-4e27-98e4-70a40da05f32+9:14381:x1876180397572352:12345-192.168.203.37@tcp:59:lhsmtool_posix.0 Request processed in 129us (1902us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265431.276571:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 17 00000100:00100000:2.0:1789265431.282938:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265431.282983:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265431.283020:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265431.283050:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265431.283070:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265431.283116:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265431.283140:0:14989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397572608 00000100:00100000:2.0:1789265431.283150:0:14989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397572608 00000100:00100000:1.0:1789265431.283150:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397572864 00000100:00100000:1.0:1789265431.283158:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397572864 00000100:00100000:2.0:1789265431.283206:0:14989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397573120 00000100:00100000:2.0:1789265431.283210:0:14989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397573120 00000100:00100000:1.0:1789265431.283220:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 25 00000100:00100000:2.0:1789265431.283226:0:14989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397572736 00000100:00100000:2.0:1789265431.283238:0:14989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397572736 00000100:00100000:1.0:1789265431.283244:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102eecca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0402ccd4-bc8e-4a9b-ad20-843e6e477335+6:2351:x1876180397572864:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789265431.283254:0:14989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397572992 00000100:00100000:2.0:1789265431.283257:0:14989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397572992 00000100:00100000:2.0:1789265431.283272:0:14989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 14 00000100:00100000:2.0:1789265431.283280:0:14989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102eeced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1015321-b6f2-4e27-98e4-70a40da05f32+5:2351:x1876180397572608:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789265431.283337:0:14989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102eeced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1015321-b6f2-4e27-98e4-70a40da05f32+5:2351:x1876180397572608:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 58us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265431.283345:0:14989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 14 00000100:00100000:2.0:1789265431.283361:0:14989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 15 00000100:00100000:2.0:1789265431.283367:0:14989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102eecdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0402ccd4-bc8e-4a9b-ad20-843e6e477335+5:2351:x1876180397573120:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789265431.283391:0:14989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102eecdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0402ccd4-bc8e-4a9b-ad20-843e6e477335+5:2351:x1876180397573120:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 24us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265431.283401:0:14989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 15 00000100:00100000:2.0:1789265431.283414:0:14989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 16 00000100:00100000:2.0:1789265431.283436:0:14989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102eecea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1015321-b6f2-4e27-98e4-70a40da05f32+5:2351:x1876180397572736:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789265431.283459:0:14989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102eecea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1015321-b6f2-4e27-98e4-70a40da05f32+5:2351:x1876180397572736:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 25us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265431.283465:0:14989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 16 00000100:00100000:2.0:1789265431.283476:0:14989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 17 00000100:00100000:2.0:1789265431.283481:0:14989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102eecf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0402ccd4-bc8e-4a9b-ad20-843e6e477335+5:2351:x1876180397572992:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789265431.283500:0:14989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102eecf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0402ccd4-bc8e-4a9b-ad20-843e6e477335+5:2351:x1876180397572992:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 20us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265431.283507:0:14989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 17 00000100:00100000:2.0:1789265431.283527:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397572480 00000100:00100000:2.0:1789265431.283531:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397572480 00000100:00080000:0.0:1789265431.283552:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789265431.283559:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789265431.283560:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265431.283620:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102eecca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0402ccd4-bc8e-4a9b-ad20-843e6e477335+6:2351:x1876180397572864:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 389us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265431.283628:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 25 00000100:00100000:2.0:1789265431.283695:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 121 00000100:00100000:2.0:1789265431.283703:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102ec4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+13:2351:x1876180397572480:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789265431.283728:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102ec4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+13:2351:x1876180397572480:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 26us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265431.283735:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 121 00000100:00100000:3.0:1789265431.318943:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265431.319047:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397573248 00000100:00100000:2.0:1789265431.319058:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397573248 00000100:00100000:2.0:1789265431.319155:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 18 00000100:00100000:2.0:1789265431.319166:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103ba7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1015321-b6f2-4e27-98e4-70a40da05f32+9:14387:x1876180397573248:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:2.0:1789265431.319185:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265431.319217:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e536e00/0x27274ba5bb953332 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f0266 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.319286:0:14305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e536400/0x27274ba5bb953339 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.319312:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e536400/0x27274ba5bb953339 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.319323:0:14305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e536400/0x27274ba5bb953339 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.319339:0:14305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537e00/0x27274ba5bb953340 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.319345:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537e00/0x27274ba5bb953340 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.319352:0:14305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537e00/0x27274ba5bb953340 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.319727:0:14305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e536400/0x27274ba5bb953339 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.319737:0:14305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e536400/0x27274ba5bb953339 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.319745:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e536400/0x27274ba5bb953339 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.319751:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a102e536400 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789265431.319755:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e536400/0x27274ba5bb953339 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.319763:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e536400/0x27274ba5bb953339 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.319775:0:14305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a101cdf4f00) 00010000:00010000:2.0:1789265431.319784:0:14305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265431.319790:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e536400/0x27274ba5bb953339 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.319797:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e536400/0x27274ba5bb953339 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.319810:0:14305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537e00/0x27274ba5bb953340 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.319816:0:14305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537e00/0x27274ba5bb953340 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.319822:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537e00/0x27274ba5bb953340 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.319828:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a102e537e00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789265431.319830:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537e00/0x27274ba5bb953340 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.319834:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537e00/0x27274ba5bb953340 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.319842:0:14305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8a1011b38600) 00010000:00010000:2.0:1789265431.319845:0:14305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265431.319848:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537e00/0x27274ba5bb953340 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.319854:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537e00/0x27274ba5bb953340 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.319885:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e536e00/0x27274ba5bb953332 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0266 expref: 10 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.319901:0:14305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a101cdf4f00) 00010000:00010000:2.0:1789265431.319903:0:14305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265431.319907:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e536e00/0x27274ba5bb953332 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0266 expref: 10 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.319918:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a102e536e00, rc 0) 00000100:00100000:2.0:1789265431.320037:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103ba7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1015321-b6f2-4e27-98e4-70a40da05f32+9:14387:x1876180397573248:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 873us (1102us total) trans 0 rc 301/301 00000100:00100000:2.0:1789265431.320044:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 18 00000100:00100000:1.0:1789265431.331436:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265431.331631:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397573376 00000100:00100000:3.0:1789265431.331641:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397573376 00000100:00100000:3.0:1789265431.331707:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 0 00000100:00100000:3.0:1789265431.331717:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02e31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a1015321-b6f2-4e27-98e4-70a40da05f32+9:14387:x1876180397573376:12345-192.168.203.37@tcp:700:lfs.0 00000100:00100000:3.0:1789265431.331818:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02e31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a1015321-b6f2-4e27-98e4-70a40da05f32+9:14387:x1876180397573376:12345-192.168.203.37@tcp:700:lfs.0 Request processed in 102us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265431.332243:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 0 00000100:00100000:2.0:1789265431.335494:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265431.335665:0:15928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397573632 00000100:00100000:0.0:1789265431.335676:0:15928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397573632 00000100:00100000:0.0:1789265431.335737:0:15928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 19 00000100:00100000:0.0:1789265431.335747:0:15928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102eecf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1015321-b6f2-4e27-98e4-70a40da05f32+9:14387:x1876180397573632:12345-192.168.203.37@tcp:36:lfs.0 00010000:00010000:0.0:1789265431.335809:0:15928:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265431.335835:0:15928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597000/0x27274ba5bb953275 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f01e1 expref: 9 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265431.335852:0:15928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a101cdf4f00) 00010000:00010000:0.0:1789265431.335856:0:15928:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789265431.336422:0:15928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35800/0x27274ba5bb953347 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265431.336444:0:15928:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb9532ad lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0243 expref: 5 pid: 15928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265431.336453:0:15928:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35800/0x27274ba5bb953347 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265431.336486:0:15928:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb9532ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0243 expref: 5 pid: 15928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265431.336503:0:15928:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb9532ad lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0243 expref: 5 pid: 15928 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265431.336516:0:15928:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a1009071500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15928:1876180414339200:192.168.203.37@tcp:104: 00000100:00100000:0.0:1789265431.336783:0:15928:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10129649c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265431.340731:0:15928:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a1009071500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15928:1876180414339200:192.168.203.37@tcp:104: 00010000:00010000:0.0:1789265431.340762:0:15928:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35800/0x27274ba5bb953347 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265431.344912:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265431.345303:0:14291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397573760 00000100:00100000:1.0:1789265431.345322:0:14291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397573760 00010000:00010000:1.0:1789265431.345377:0:14291:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb9532ad lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0243 expref: 6 pid: 15928 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265431.345429:0:14291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 9 00000100:00100000:1.0:1789265431.345441:0:14291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102eecc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0402ccd4-bc8e-4a9b-ad20-843e6e477335+6:2351:x1876180397573760:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265431.345459:0:14291:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265431.345467:0:14291:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb9532ad lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0243 expref: 6 pid: 15928 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.345487:0:14291:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb9532ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0243 expref: 6 pid: 15928 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.345622:0:14291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb9532ad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0243 expref: 6 pid: 15928 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.345720:0:14291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a101cdf4f00) 00010000:00010000:1.0:1789265431.345728:0:14291:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35800/0x27274ba5bb953347 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.345738:0:14291:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35800/0x27274ba5bb953347 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.345746:0:14291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35800/0x27274ba5bb953347 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.345845:0:14291:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265431.345924:0:14291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102eecc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0402ccd4-bc8e-4a9b-ad20-843e6e477335+5:2351:x1876180397573760:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 485us (1026us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265431.345932:0:14291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 9 00010000:00010000:0.0:1789265431.347644:0:15928:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35800/0x27274ba5bb953347 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789265431.348448:0:14336:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789265431.348749:0:15928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35800/0x27274ba5bb953347 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.348855:0:15928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb95334e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.348871:0:15928:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb95334e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.348882:0:15928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb95334e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265431.355869:0:15928:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789265431.355888:0:15928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35800/0x27274ba5bb953347 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.355898:0:15928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35800/0x27274ba5bb953347 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.355984:0:15928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35800/0x27274ba5bb953347 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.355992:0:15928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fa35800 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789265431.355997:0:15928:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35800/0x27274ba5bb953347 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.356004:0:15928:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35800/0x27274ba5bb953347 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.356022:0:15928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a101cdf4f00) 00010000:00010000:1.0:1789265431.356025:0:15928:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265431.356029:0:15928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35800/0x27274ba5bb953347 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.356036:0:15928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35800/0x27274ba5bb953347 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789265431.356057:0:15928:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e7c62bcd reply state 000000009d6cbcc5 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb95334e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265431.356066:0:15928:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789265431.357028:0:15928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102eecf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1015321-b6f2-4e27-98e4-70a40da05f32+10:14387:x1876180397573632:12345-192.168.203.37@tcp:36:lfs.0 Request processed in 21276us (21545us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1789265431.357038:0:15928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 19 00010000:00010000:0.0:1789265431.367269:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb95334e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265431.367304:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb95334e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265431.367312:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb95334e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265431.367318:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b597200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789265431.367322:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb95334e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265431.367329:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb95334e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265431.367344:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8a101cdf4a00) 00010000:00010000:0.0:1789265431.367347:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265431.367351:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb95334e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265431.367356:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb95334e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265431.466021:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265431.466297:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397573888 00000100:00100000:1.0:1789265431.466308:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397573888 00000100:00100000:1.0:1789265431.466366:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 20 00000100:00100000:1.0:1789265431.466378:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102eecc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1015321-b6f2-4e27-98e4-70a40da05f32+9:14395:x1876180397573888:12345-192.168.203.37@tcp:101:lctl.0 00010000:00010000:1.0:1789265431.466425:0:14306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265431.466447:0:14306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb953355 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f026d expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.466510:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596800/0x27274ba5bb95335c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.466524:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596800/0x27274ba5bb95335c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.466535:0:14306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596800/0x27274ba5bb95335c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265431.466569:0:14306:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789265431.466573:0:14306:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789265431.466608:0:14306:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596800/0x27274ba5bb95335c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.466632:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb953355 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f026d expref: 11 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.466649:0:14306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596800/0x27274ba5bb95335c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f026d expref: 10 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.466831:0:14306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a101cdf4f00) 00010000:00010000:1.0:1789265431.466836:0:14306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789265431.466839:0:14306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a101b596800, rc 0) 00000100:00100000:1.0:1789265431.467423:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102eecc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1015321-b6f2-4e27-98e4-70a40da05f32+10:14395:x1876180397573888:12345-192.168.203.37@tcp:101:lctl.0 Request processed in 1045us (1408us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265431.467443:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 20 00000100:00100000:2.0:1789265431.487275:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265431.487497:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397574016 00000100:00100000:1.0:1789265431.487510:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397574016 00000100:00100000:1.0:1789265431.487686:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 21 00000100:00100000:1.0:1789265431.487699:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102eecce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0402ccd4-bc8e-4a9b-ad20-843e6e477335+5:14396:x1876180397574016:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:1.0:1789265431.487726:0:14304:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265431.487753:0:14304:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb953363 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f0274 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.487837:0:14304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb95336a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.487854:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb95336a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.487868:0:14304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb95336a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265431.487911:0:14304:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789265431.487915:0:14304:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789265431.487939:0:14304:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb95336a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.487966:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb953363 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0274 expref: 7 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.487997:0:14304:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597200/0x27274ba5bb95336a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0274 expref: 6 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.488033:0:14304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a101cdf4f00) 00010000:00010000:1.0:1789265431.488036:0:14304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789265431.488040:0:14304:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a101b597200, rc 0) 00000100:00100000:1.0:1789265431.488182:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102eecce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0402ccd4-bc8e-4a9b-ad20-843e6e477335+6:14396:x1876180397574016:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 485us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265431.488189:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 21 00000100:00100000:3.0:1789265431.490795:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265431.490943:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397574144 00000100:00100000:2.0:1789265431.490956:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397574144 00000100:00100000:2.0:1789265431.491361:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 22 00000100:00100000:2.0:1789265431.491375:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103ba78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0402ccd4-bc8e-4a9b-ad20-843e6e477335+6:14396:x1876180397574144:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:2.0:1789265431.491404:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265431.491430:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e536400/0x27274ba5bb953371 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f027b expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.491512:0:14305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537c00/0x27274ba5bb953378 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.491530:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537c00/0x27274ba5bb953378 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.491567:0:14305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537c00/0x27274ba5bb953378 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.491584:0:14305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537000/0x27274ba5bb95337f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.491592:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537000/0x27274ba5bb95337f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.491599:0:14305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537000/0x27274ba5bb95337f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.491720:0:14305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e536600/0x27274ba5bb953386 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.491728:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e536600/0x27274ba5bb953386 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.491735:0:14305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e536600/0x27274ba5bb953386 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265431.491772:0:14305:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789265431.491776:0:14305:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789265431.491802:0:14305:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e536600/0x27274ba5bb953386 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.491816:0:14305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537c00/0x27274ba5bb953378 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.491823:0:14305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537c00/0x27274ba5bb953378 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.491840:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537c00/0x27274ba5bb953378 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.491848:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a102e537c00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789265431.491853:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537c00/0x27274ba5bb953378 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.491862:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537c00/0x27274ba5bb953378 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.491877:0:14305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a101cdf4f00) 00010000:00010000:2.0:1789265431.491880:0:14305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265431.491886:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537c00/0x27274ba5bb953378 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.491892:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537c00/0x27274ba5bb953378 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.491907:0:14305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537000/0x27274ba5bb95337f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.491914:0:14305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537000/0x27274ba5bb95337f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.491920:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537000/0x27274ba5bb95337f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.491924:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a102e537000 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789265431.491927:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537000/0x27274ba5bb95337f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.491943:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537000/0x27274ba5bb95337f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.491951:0:14305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8a1011b38600) 00010000:00010000:2.0:1789265431.491953:0:14305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265431.491957:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537000/0x27274ba5bb95337f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.491962:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537000/0x27274ba5bb95337f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.492011:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e536400/0x27274ba5bb953371 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f027b expref: 8 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.492027:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e536600/0x27274ba5bb953386 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f027b expref: 7 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.492034:0:14305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a1011b38000) 00010000:00010000:2.0:1789265431.492037:0:14305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789265431.492039:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a102e536600, rc 0) 00000100:00100000:2.0:1789265431.492172:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103ba78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0402ccd4-bc8e-4a9b-ad20-843e6e477335+7:14396:x1876180397574144:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 800us (1391us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265431.492180:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 22 00000100:00100000:3.0:1789265431.495889:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265431.496001:0:15928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397574400 00000100:00100000:2.0:1789265431.496015:0:15928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397574400 00000100:00100000:2.0:1789265431.496122:0:15928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 23 00000100:00100000:2.0:1789265431.496134:0:15928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103ba79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0402ccd4-bc8e-4a9b-ad20-843e6e477335+7:14396:x1876180397574400:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:2.0:1789265431.496180:0:15928:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265431.496207:0:15928:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537200/0x27274ba5bb95338d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f0282 expref: -99 pid: 15928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265431.496331:0:15928:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789265431.496488:0:15928:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537200/0x27274ba5bb95338d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0282 expref: 9 pid: 15928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.496505:0:15928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a101cdf4f00) 00010000:00010000:2.0:1789265431.496508:0:15928:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789265431.496513:0:15928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537200/0x27274ba5bb95338d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0282 expref: 9 pid: 15928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.496529:0:15928:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a102e537200, rc 0) 00000100:00100000:2.0:1789265431.496601:0:15928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103ba79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0402ccd4-bc8e-4a9b-ad20-843e6e477335+8:14396:x1876180397574400:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 470us (727us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1789265431.496609:0:15928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 23 00000100:00100000:3.0:1789265431.499797:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265431.500363:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397574656 00000100:00100000:1.0:1789265431.500379:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397574656 00000100:00100000:1.0:1789265431.500701:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 24 00000100:00100000:1.0:1789265431.500714:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103ba78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0402ccd4-bc8e-4a9b-ad20-843e6e477335+8:14396:x1876180397574656:12345-192.168.203.37@tcp:36:lfs.0 00010000:00010000:1.0:1789265431.500796:0:14306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265431.500832:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e536600/0x27274ba5bb953386 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f027b expref: 8 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.500854:0:14306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a1011b38000) 00010000:00010000:1.0:1789265431.500867:0:14306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789265431.500900:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb95339b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.500915:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb95339b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.500925:0:14306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb95339b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789265431.501276:0:14306:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000015cd82e9 reply state 00000000495e633d transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb95339b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265431.501310:0:14306:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789265431.501320:0:14306:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1789265431.501510:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103ba78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0402ccd4-bc8e-4a9b-ad20-843e6e477335+9:14396:x1876180397574656:12345-192.168.203.37@tcp:36:lfs.0 Request processed in 797us (1730us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1789265431.501519:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 24 00010000:00010000:2.0:1789265431.502953:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb95339b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.502972:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb95339b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.502980:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb95339b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.502987:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b597c00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789265431.502993:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb95339b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.503032:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb95339b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.503051:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a101cdf4900) 00010000:00010000:2.0:1789265431.503054:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1789265431.503060:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb95339b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.503070:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb95339b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265431.506687:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265431.512032:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397574912 00000100:00100000:1.0:1789265431.512047:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397574912 00000100:00100000:1.0:1789265431.512136:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 2 00000100:00100000:1.0:1789265431.512148:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103ba78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0402ccd4-bc8e-4a9b-ad20-843e6e477335+8:14396:x1876180397574912:12345-192.168.203.37@tcp:35:lfs.0 00000100:00100000:1.0:1789265431.512644:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103ba78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0402ccd4-bc8e-4a9b-ad20-843e6e477335+9:14396:x1876180397574912:12345-192.168.203.37@tcp:35:lfs.0 Request processed in 496us (5966us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1789265431.512652:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 2 00000100:00100000:3.0:1789265431.516604:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265431.517499:0:15928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397575168 00000100:00100000:2.0:1789265431.517511:0:15928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397575168 00000100:00100000:2.0:1789265431.517574:0:15928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 25 00000100:00100000:2.0:1789265431.517586:0:15928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103ba7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0402ccd4-bc8e-4a9b-ad20-843e6e477335+9:14396:x1876180397575168:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:2.0:1789265431.517609:0:15928:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265431.517631:0:15928:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e536400/0x27274ba5bb9533a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f0289 expref: -99 pid: 15928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.517704:0:15928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537000/0x27274ba5bb9533a9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.517719:0:15928:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537000/0x27274ba5bb9533a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.517729:0:15928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537000/0x27274ba5bb9533a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.517744:0:15928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537c00/0x27274ba5bb9533b0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.517764:0:15928:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537c00/0x27274ba5bb9533b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.517772:0:15928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537c00/0x27274ba5bb9533b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265431.517897:0:15928:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789265431.517984:0:15928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537000/0x27274ba5bb9533a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.517992:0:15928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537000/0x27274ba5bb9533a9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.517999:0:15928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537000/0x27274ba5bb9533a9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.518006:0:15928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a102e537000 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789265431.518010:0:15928:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537000/0x27274ba5bb9533a9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.518018:0:15928:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537000/0x27274ba5bb9533a9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.518030:0:15928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a101cdf4f00) 00010000:00010000:2.0:1789265431.518034:0:15928:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265431.518039:0:15928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537000/0x27274ba5bb9533a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.518045:0:15928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537000/0x27274ba5bb9533a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.518069:0:15928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537c00/0x27274ba5bb9533b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.518128:0:15928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537c00/0x27274ba5bb9533b0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.518134:0:15928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537c00/0x27274ba5bb9533b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.518140:0:15928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a102e537c00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789265431.518143:0:15928:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537c00/0x27274ba5bb9533b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.518149:0:15928:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537c00/0x27274ba5bb9533b0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.518157:0:15928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8a1011b38600) 00010000:00010000:2.0:1789265431.518160:0:15928:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265431.518163:0:15928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537c00/0x27274ba5bb9533b0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.518169:0:15928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537c00/0x27274ba5bb9533b0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.518206:0:15928:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e536400/0x27274ba5bb9533a2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0289 expref: 11 pid: 15928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.518216:0:15928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a101cdf4f00) 00010000:00010000:2.0:1789265431.518219:0:15928:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789265431.518238:0:15928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e536400/0x27274ba5bb9533a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0289 expref: 11 pid: 15928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.518248:0:15928:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a102e536400, rc 0) 00000100:00100000:2.0:1789265431.518304:0:15928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103ba7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0402ccd4-bc8e-4a9b-ad20-843e6e477335+10:14396:x1876180397575168:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 721us (1710us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1789265431.518322:0:15928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 25 00000100:00100000:2.0:1789265431.524674:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265431.524757:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397575296 00000100:00100000:3.0:1789265431.524768:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397575296 00000100:00100000:3.0:1789265431.524940:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 26 00000100:00100000:3.0:1789265431.524966:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102eece680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0402ccd4-bc8e-4a9b-ad20-843e6e477335+10:14396:x1876180397575296:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:3.0:1789265431.524989:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265431.525033:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a0f03142e00/0x27274ba5bb9533be lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f0290 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265431.525157:0:14305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a0f03142000/0x27274ba5bb9533c5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265431.525171:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a0f03142000/0x27274ba5bb9533c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265431.525184:0:14305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a0f03142000/0x27274ba5bb9533c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265431.525207:0:14305:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789265431.525211:0:14305:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789265431.525241:0:14305:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a0f03142000/0x27274ba5bb9533c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265431.525267:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a0f03142e00/0x27274ba5bb9533be lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0290 expref: 12 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265431.525284:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a0f03142000/0x27274ba5bb9533c5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0290 expref: 11 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265431.525292:0:14305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a1012931300) 00010000:00010000:3.0:1789265431.525295:0:14305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789265431.525298:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a0f03142000, rc 0) 00000100:00100000:3.0:1789265431.525362:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102eece680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0402ccd4-bc8e-4a9b-ad20-843e6e477335+11:14396:x1876180397575296:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 398us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265431.525379:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 26 00000100:00100000:3.0:1789265431.537989:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265431.538127:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397575424 00000100:00100000:0.0:1789265431.538137:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397575424 00000100:00100000:0.0:1789265431.538197:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 3 00000100:00100000:0.0:1789265431.538207:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103ba7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0402ccd4-bc8e-4a9b-ad20-843e6e477335+11:14396:x1876180397575424:12345-192.168.203.37@tcp:37:lfs.0 00000100:00100000:2.0:1789265431.547184:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103ba7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0402ccd4-bc8e-4a9b-ad20-843e6e477335+11:14396:x1876180397575424:12345-192.168.203.37@tcp:37:lfs.0 Request processed in 8966us (9192us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265431.547203:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 3 00000100:00100000:2.0:1789265431.556318:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265431.556456:0:16187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397575680 00000100:00100000:3.0:1789265431.556466:0:16187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397575680 00000100:00100000:3.0:1789265431.556524:0:16187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 4 00000100:00100000:3.0:1789265431.556535:0:16187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a101876f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0402ccd4-bc8e-4a9b-ad20-843e6e477335+11:14396:x1876180397575680:12345-192.168.203.37@tcp:35:lfs.0 00000100:00100000:3.0:1789265431.556775:0:16187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a101876f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0402ccd4-bc8e-4a9b-ad20-843e6e477335+12:14396:x1876180397575680:12345-192.168.203.37@tcp:35:lfs.0 Request processed in 241us (466us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1789265431.556783:0:16187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 4 00000100:00100000:3.0:1789265431.655297:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265431.655707:0:15928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397575808 00000100:00100000:2.0:1789265431.655732:0:15928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397575808 00000100:00100000:2.0:1789265431.655813:0:15928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 27 00000100:00100000:2.0:1789265431.655824:0:15928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103ba7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1015321-b6f2-4e27-98e4-70a40da05f32+10:14402:x1876180397575808:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:2.0:1789265431.655844:0:15928:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265431.655866:0:15928:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e536400/0x27274ba5bb9533cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f0297 expref: -99 pid: 15928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.655941:0:15928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537c00/0x27274ba5bb9533d3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.655956:0:15928:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537c00/0x27274ba5bb9533d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.655966:0:15928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537c00/0x27274ba5bb9533d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.655997:0:15928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537000/0x27274ba5bb9533da lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.656004:0:15928:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537000/0x27274ba5bb9533da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.656010:0:15928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537000/0x27274ba5bb9533da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.656172:0:15928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537200/0x27274ba5bb9533e1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.656182:0:15928:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537200/0x27274ba5bb9533e1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.656188:0:15928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537200/0x27274ba5bb9533e1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265431.656216:0:15928:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789265431.656219:0:15928:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789265431.656271:0:15928:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537200/0x27274ba5bb9533e1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.656284:0:15928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537c00/0x27274ba5bb9533d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.656290:0:15928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537c00/0x27274ba5bb9533d3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.656295:0:15928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537c00/0x27274ba5bb9533d3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.656353:0:15928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a102e537c00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789265431.656358:0:15928:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537c00/0x27274ba5bb9533d3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.656365:0:15928:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537c00/0x27274ba5bb9533d3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.656376:0:15928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a101cdf4f00) 00010000:00010000:2.0:1789265431.656379:0:15928:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265431.656383:0:15928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537c00/0x27274ba5bb9533d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.656388:0:15928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537c00/0x27274ba5bb9533d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.656401:0:15928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537000/0x27274ba5bb9533da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.656405:0:15928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537000/0x27274ba5bb9533da lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.656410:0:15928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537000/0x27274ba5bb9533da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.656415:0:15928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a102e537000 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789265431.656417:0:15928:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537000/0x27274ba5bb9533da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.656422:0:15928:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537000/0x27274ba5bb9533da lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.656437:0:15928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8a1011b38600) 00010000:00010000:2.0:1789265431.656439:0:15928:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265431.656442:0:15928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537000/0x27274ba5bb9533da lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.656446:0:15928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537000/0x27274ba5bb9533da lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.656474:0:15928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e536400/0x27274ba5bb9533cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0297 expref: 12 pid: 15928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.656486:0:15928:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537200/0x27274ba5bb9533e1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0297 expref: 11 pid: 15928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.656493:0:15928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a1012931300) 00010000:00010000:2.0:1789265431.656495:0:15928:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789265431.656497:0:15928:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a102e537200, rc 0) 00000100:00100000:2.0:1789265431.656574:0:15928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103ba7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1015321-b6f2-4e27-98e4-70a40da05f32+11:14402:x1876180397575808:12345-192.168.203.37@tcp:101:bash.0 Request processed in 753us (1291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265431.656581:0:15928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 27 00000100:00100000:3.0:1789265431.660730:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265431.660828:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397576064 00000100:00100000:2.0:1789265431.660846:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397576064 00000100:00100000:2.0:1789265431.660933:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 28 00000100:00100000:2.0:1789265431.660944:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103ba78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1015321-b6f2-4e27-98e4-70a40da05f32+11:14402:x1876180397576064:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:2.0:1789265431.660973:0:14306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265431.661012:0:14306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e536600/0x27274ba5bb9533e8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f029e expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.661265:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537e00/0x27274ba5bb9533ef lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.661287:0:14306:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a0f03142000/0x27274ba5bb9533c5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0290 expref: 11 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.661297:0:14306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537e00/0x27274ba5bb9533ef lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.661345:0:14306:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a0f03142000/0x27274ba5bb9533c5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0290 expref: 11 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.661365:0:14306:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a0f03142000/0x27274ba5bb9533c5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0290 expref: 11 pid: 14305 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265431.661382:0:14306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102eecd500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14306:1876180414339328:192.168.203.37@tcp:104: 00000100:00100000:2.0:1789265431.663159:0:14306:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10107f7180 going to sleep for 11 seconds 00000100:00100000:1.0:1789265431.668503:0:14306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102eecd500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14306:1876180414339328:192.168.203.37@tcp:104: 00010000:00010000:1.0:1789265431.668545:0:14306:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537e00/0x27274ba5bb9533ef lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265431.668645:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265431.668809:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397576192 00000100:00100000:0.0:1789265431.668820:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397576192 00010000:00010000:0.0:1789265431.668872:0:14290:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a0f03142000/0x27274ba5bb9533c5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0290 expref: 12 pid: 14305 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265431.669540:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 10 00000100:00100000:0.0:1789265431.669556:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103ba7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0402ccd4-bc8e-4a9b-ad20-843e6e477335+12:2350:x1876180397576192:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265431.669578:0:14290:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265431.669588:0:14290:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a0f03142000/0x27274ba5bb9533c5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0290 expref: 12 pid: 14305 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265431.669609:0:14290:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a0f03142000/0x27274ba5bb9533c5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0290 expref: 12 pid: 14305 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265431.669639:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a0f03142000/0x27274ba5bb9533c5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0290 expref: 12 pid: 14305 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265431.669672:0:14290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a1012931300) 00010000:00010000:0.0:1789265431.669678:0:14290:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537e00/0x27274ba5bb9533ef lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265431.669689:0:14290:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537e00/0x27274ba5bb9533ef lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265431.669698:0:14290:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537e00/0x27274ba5bb9533ef lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265431.669733:0:14290:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265431.669810:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103ba7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0402ccd4-bc8e-4a9b-ad20-843e6e477335+11:2350:x1876180397576192:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 258us (1945us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265431.669820:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 10 00010000:00010000:1.0:1789265431.669904:0:14306:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537e00/0x27274ba5bb9533ef lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.669912:0:14306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537e00/0x27274ba5bb9533ef lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.669944:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb9533f6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.669956:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb9533f6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.670002:0:14306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb9533f6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.672600:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596c00/0x27274ba5bb9533fd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.672621:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596c00/0x27274ba5bb9533fd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.672634:0:14306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596c00/0x27274ba5bb9533fd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265431.672646:0:14306:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789265431.672675:0:14306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537e00/0x27274ba5bb9533ef lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.672682:0:14306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537e00/0x27274ba5bb9533ef lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.672689:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537e00/0x27274ba5bb9533ef lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.672695:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a102e537e00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789265431.672700:0:14306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537e00/0x27274ba5bb9533ef lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.672708:0:14306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537e00/0x27274ba5bb9533ef lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.672721:0:14306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a1012931300) 00010000:00010000:1.0:1789265431.672724:0:14306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265431.672739:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537e00/0x27274ba5bb9533ef lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.672746:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537e00/0x27274ba5bb9533ef lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789265431.672762:0:14306:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ca443337 reply state 000000000c8adb72 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb9533f6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265431.672769:0:14306:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789265431.672871:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e536600/0x27274ba5bb9533e8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f029e expref: 14 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.672886:0:14306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596c00/0x27274ba5bb9533fd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f029e expref: 13 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.672893:0:14306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a101cdf4200) 00010000:00010000:1.0:1789265431.672895:0:14306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1789265431.672898:0:14306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a101b596c00, rc 0) 00000100:00100000:1.0:1789265431.673031:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103ba78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1015321-b6f2-4e27-98e4-70a40da05f32+14:14402:x1876180397576064:12345-192.168.203.37@tcp:101:bash.0 Request processed in 12013us (12242us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1789265431.673040:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 28 00010000:00010000:2.0:1789265431.679947:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb9533f6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.679966:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb9533f6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.679974:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb9533f6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.679980:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b597a00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789265431.679986:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb9533f6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.680010:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb9533f6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.680028:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8a101cdf4400) 00010000:00010000:2.0:1789265431.680031:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265431.680036:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb9533f6 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.680043:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb9533f6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265431.695433:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265431.695578:0:15928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397576320 00000100:00100000:2.0:1789265431.695595:0:15928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397576320 00000100:00100000:2.0:1789265431.695671:0:15928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 29 00000100:00100000:2.0:1789265431.695681:0:15928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103ba79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1015321-b6f2-4e27-98e4-70a40da05f32+13:14402:x1876180397576320:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:2.0:1789265431.695706:0:15928:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265431.695727:0:15928:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e536400/0x27274ba5bb95340b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f02a5 expref: -99 pid: 15928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.695803:0:15928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537000/0x27274ba5bb953412 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.695817:0:15928:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537000/0x27274ba5bb953412 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.695829:0:15928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537000/0x27274ba5bb953412 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265431.695908:0:15928:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789265431.695928:0:15928:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789265431.695950:0:15928:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537000/0x27274ba5bb953412 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.695962:0:15928:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537000/0x27274ba5bb953412 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.695987:0:15928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e536400/0x27274ba5bb95340b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f02a5 expref: 15 pid: 15928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.696006:0:15928:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537000/0x27274ba5bb953412 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f02a5 expref: 14 pid: 15928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.696014:0:15928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a101cdf4200) 00010000:00010000:2.0:1789265431.696017:0:15928:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789265431.696020:0:15928:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a102e537000, rc 0) 00000100:00100000:2.0:1789265431.696136:0:15928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103ba79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1015321-b6f2-4e27-98e4-70a40da05f32+14:14402:x1876180397576320:12345-192.168.203.37@tcp:101:bash.0 Request processed in 456us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265431.696144:0:15928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 29 00000100:00100000:1.0:1789265431.701580:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265431.701672:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397576576 00000100:00100000:2.0:1789265431.701683:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397576576 00000100:00100000:2.0:1789265431.701745:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 5 00000100:00100000:2.0:1789265431.701756:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02e30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1015321-b6f2-4e27-98e4-70a40da05f32+14:14402:x1876180397576576:12345-192.168.203.37@tcp:35:bash.0 00000100:00100000:2.0:1789265431.702355:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02e30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1015321-b6f2-4e27-98e4-70a40da05f32+15:14402:x1876180397576576:12345-192.168.203.37@tcp:35:bash.0 Request processed in 599us (783us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1789265431.702364:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 5 00000100:00100000:3.0:1789265431.785416:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265431.785786:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397576832 00000100:00100000:2.0:1789265431.785801:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397576832 00000100:00100000:2.0:1789265431.785895:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 30 00000100:00100000:2.0:1789265431.785932:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02df5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1015321-b6f2-4e27-98e4-70a40da05f32+15:14412:x1876180397576832:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:2.0:1789265431.785970:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265431.785998:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e536400/0x27274ba5bb953419 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f02ac expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265431.786452:0:14305:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789265431.786625:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e536400/0x27274ba5bb953419 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f02ac expref: 17 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.786644:0:14305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a101cdf4f00) 00010000:00010000:2.0:1789265431.786648:0:14305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789265431.786654:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e536400/0x27274ba5bb953419 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f02ac expref: 17 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.786829:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a102e536400, rc 0) 00000100:00100000:3.0:1789265431.791247:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02df5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1015321-b6f2-4e27-98e4-70a40da05f32+16:14412:x1876180397576832:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 5144us (5673us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1789265431.791264:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 30 00000100:00100000:2.0:1789265431.796864:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265431.797196:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397577088 00000100:00100000:1.0:1789265431.797210:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397577088 00000100:00100000:1.0:1789265431.797325:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 6 00000100:00100000:1.0:1789265431.797338:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102eecc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1015321-b6f2-4e27-98e4-70a40da05f32+16:14412:x1876180397577088:12345-192.168.203.37@tcp:35:lfs.0 00000100:00100000:1.0:1789265431.797673:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102eecc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1015321-b6f2-4e27-98e4-70a40da05f32+17:14412:x1876180397577088:12345-192.168.203.37@tcp:35:lfs.0 Request processed in 335us (821us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1789265431.797704:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 6 00000100:00100000:1.0:1789265431.837536:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265431.837692:0:15928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397577344 00000100:00100000:2.0:1789265431.837712:0:15928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397577344 00000100:00100000:2.0:1789265431.837779:0:15928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 31 00000100:00100000:2.0:1789265431.837791:0:15928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02e33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1015321-b6f2-4e27-98e4-70a40da05f32+17:14415:x1876180397577344:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:2.0:1789265431.837832:0:15928:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265431.837860:0:15928:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537c00/0x27274ba5bb953427 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f02b3 expref: -99 pid: 15928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.837984:0:15928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e536c00/0x27274ba5bb95342e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.838000:0:15928:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e536c00/0x27274ba5bb95342e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.838030:0:15928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e536c00/0x27274ba5bb95342e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265431.838043:0:15928:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789265431.838601:0:15928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537c00/0x27274ba5bb953427 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f02b3 expref: 20 pid: 15928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.838627:0:15928:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e536c00/0x27274ba5bb95342e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f02b3 expref: 19 pid: 15928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265431.838636:0:15928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a101cdf4200) 00010000:00010000:2.0:1789265431.838639:0:15928:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789265431.838643:0:15928:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a102e536c00, rc 0) 00000100:00100000:2.0:1789265431.838881:0:15928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02e33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1015321-b6f2-4e27-98e4-70a40da05f32+19:14415:x1876180397577344:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 1090us (1357us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1789265431.838889:0:15928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 31 00000100:00100000:2.0:1789265431.842651:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265431.842879:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265431.843983:0:14291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397577600 00000100:00100000:3.0:1789265431.844001:0:14291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397577600 00000100:00100000:3.0:1789265431.844141:0:14291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 0 00000100:00100000:3.0:1789265431.844155:0:14291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102eecd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1015321-b6f2-4e27-98e4-70a40da05f32+19:2351:x1876180397577600:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265431.844186:0:14291:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265431.844222:0:14291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e536c00/0x27274ba5bb95342e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f02b3 expref: 19 pid: 15928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265431.844280:0:14291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a101cdf4200) 00010000:00010000:3.0:1789265431.844287:0:14291:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265431.844368:0:14291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102eecd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1015321-b6f2-4e27-98e4-70a40da05f32+18:2351:x1876180397577600:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 216us (1488us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265431.844378:0:14291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 0 00000100:00100000:1.0:1789265431.848710:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397577472 00000100:00100000:1.0:1789265431.848730:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397577472 00000100:00100000:1.0:1789265431.848831:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 32 00000100:00100000:1.0:1789265431.848844:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102eece300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1015321-b6f2-4e27-98e4-70a40da05f32+18:14415:x1876180397577472:12345-192.168.203.37@tcp:54:lfs.0 00010000:00010000:1.0:1789265431.849383:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596400/0x27274ba5bb95343c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.849406:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596400/0x27274ba5bb95343c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.849420:0:14306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596400/0x27274ba5bb95343c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.849453:0:14306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596400/0x27274ba5bb95343c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.849461:0:14306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596400/0x27274ba5bb95343c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.849542:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596400/0x27274ba5bb95343c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.849548:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b596400 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789265431.849553:0:14306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596400/0x27274ba5bb95343c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.849561:0:14306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596400/0x27274ba5bb95343c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.849601:0:14306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a101cdf4200) 00010000:00010000:1.0:1789265431.849604:0:14306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789265431.849609:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596400/0x27274ba5bb95343c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265431.849617:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596400/0x27274ba5bb95343c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265431.849730:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102eece300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1015321-b6f2-4e27-98e4-70a40da05f32+18:14415:x1876180397577472:12345-192.168.203.37@tcp:54:lfs.0 Request processed in 886us (7091us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265431.849739:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 32 00000100:00100000:2.0:1789265431.856296:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265431.856393:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397577856 00000100:00100000:0.0:1789265431.856422:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397577856 00000100:00100000:0.0:1789265431.856525:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 7 00000100:00100000:0.0:1789265431.856537:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10037b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1015321-b6f2-4e27-98e4-70a40da05f32+18:14415:x1876180397577856:12345-192.168.203.37@tcp:35:lfs.0 00000100:00100000:0.0:1789265431.856860:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10037b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1015321-b6f2-4e27-98e4-70a40da05f32+19:14415:x1876180397577856:12345-192.168.203.37@tcp:35:lfs.0 Request processed in 324us (577us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1789265431.856870:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 7 00010000:00010000:3.0:1789265431.986739:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265432.132352:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265432.132526:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397578112 00000100:00100000:1.0:1789265432.132545:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397578112 00000100:00100000:1.0:1789265432.132708:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 33 00000100:00100000:1.0:1789265432.132722:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1016d46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1015321-b6f2-4e27-98e4-70a40da05f32+19:14446:x1876180397578112:12345-192.168.203.37@tcp:101:cat.0 00010000:00010000:1.0:1789265432.132759:0:14304:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265432.132787:0:14304:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596400/0x27274ba5bb953443 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f02ba expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.132940:0:14304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597000/0x27274ba5bb95344a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.132969:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597000/0x27274ba5bb95344a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.132985:0:14304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597000/0x27274ba5bb95344a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265432.133002:0:14304:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789265432.133354:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596400/0x27274ba5bb953443 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f02ba expref: 22 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.133378:0:14304:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597000/0x27274ba5bb95344a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f02ba expref: 21 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.133389:0:14304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a101cdf4200) 00010000:00010000:1.0:1789265432.133392:0:14304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789265432.133397:0:14304:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a101b597000, rc 0) 00000100:00100000:1.0:1789265432.133620:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1016d46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1015321-b6f2-4e27-98e4-70a40da05f32+21:14446:x1876180397578112:12345-192.168.203.37@tcp:101:cat.0 Request processed in 900us (1277us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1789265432.133629:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 33 00000100:00100000:1.0:1789265432.136734:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265432.136799:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265432.136913:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397578368 00000100:00100000:0.0:1789265432.136927:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397578368 00000100:00100000:2.0:1789265432.137378:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397578496 00000100:00100000:2.0:1789265432.137384:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397578496 00000100:00100000:2.0:1789265432.137444:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 1 00000100:00100000:2.0:1789265432.137456:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102efe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a1015321-b6f2-4e27-98e4-70a40da05f32+22:2351:x1876180397578496:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265432.137486:0:14290:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265432.137514:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597000/0x27274ba5bb95344a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f02ba expref: 22 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265432.137552:0:14290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a101cdf4200) 00010000:00010000:2.0:1789265432.137556:0:14290:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265432.137624:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102efe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a1015321-b6f2-4e27-98e4-70a40da05f32+21:2351:x1876180397578496:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 170us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265432.137632:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 1 00000100:00100000:0.0:1789265432.138058:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 8 00000100:00100000:0.0:1789265432.138069:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102efe2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1015321-b6f2-4e27-98e4-70a40da05f32+20:14446:x1876180397578368:12345-192.168.203.37@tcp:35:cat.0 00000100:00100000:0.0:1789265432.138544:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102efe2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1015321-b6f2-4e27-98e4-70a40da05f32+21:14446:x1876180397578368:12345-192.168.203.37@tcp:35:cat.0 Request processed in 476us (1823us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1789265432.138552:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 8 00000100:00100000:1.0:1789265432.213414:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265432.213601:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397578752 00000100:00100000:2.0:1789265432.213616:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397578752 00000100:00100000:2.0:1789265432.213695:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 34 00000100:00100000:2.0:1789265432.213708:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102efe1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1015321-b6f2-4e27-98e4-70a40da05f32+21:14452:x1876180397578752:12345-192.168.203.37@tcp:101:dd.0 00010000:00010000:2.0:1789265432.213740:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265432.213768:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537a00/0x27274ba5bb953458 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f02c1 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265432.213906:0:14305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537600/0x27274ba5bb95345f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265432.213924:0:14305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596c00/0x27274ba5bb9533fd lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f029e expref: 22 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265432.213932:0:14305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537000/0x27274ba5bb953412 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f02a5 expref: 22 pid: 15928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265432.213940:0:14305:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537600/0x27274ba5bb95345f lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265432.213982:0:14305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537000/0x27274ba5bb953412 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f02a5 expref: 22 pid: 15928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265432.214327:0:14305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537000/0x27274ba5bb953412 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f02a5 expref: 22 pid: 15928 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265432.214344:0:14305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10037b0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14305:1876180414339456:192.168.203.37@tcp:104: 00010000:00010000:2.0:1789265432.214557:0:14305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596c00/0x27274ba5bb9533fd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f029e expref: 22 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265432.214566:0:14305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596c00/0x27274ba5bb9533fd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f029e expref: 22 pid: 14306 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265432.214576:0:14305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a10037b0700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14305:1876180414339584:192.168.203.37@tcp:104: 00000100:00100000:2.0:1789265432.214610:0:14305:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a10107f7000 going to sleep for 11 seconds 00000100:00100000:3.0:1789265432.219276:0:14305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10037b0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14305:1876180414339456:192.168.203.37@tcp:104: 00000100:00100000:3.0:1789265432.219307:0:14305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a10037b0700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14305:1876180414339584:192.168.203.37@tcp:104: 00010000:00010000:3.0:1789265432.219343:0:14305:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537600/0x27274ba5bb95345f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265432.221602:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265432.221660:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265432.221781:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397578880 00000100:00100000:0.0:1789265432.221794:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397578880 00010000:00010000:0.0:1789265432.221844:0:14290:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596c00/0x27274ba5bb9533fd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f029e expref: 23 pid: 14306 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265432.221926:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397579008 00000100:00100000:0.0:1789265432.221930:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397579008 00010000:00010000:0.0:1789265432.221947:0:14290:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537000/0x27274ba5bb953412 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f02a5 expref: 24 pid: 15928 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265432.222652:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 11 00000100:00100000:0.0:1789265432.222670:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a104163d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a1015321-b6f2-4e27-98e4-70a40da05f32+24:2349:x1876180397578880:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265432.222692:0:14290:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265432.222703:0:14290:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596c00/0x27274ba5bb9533fd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f029e expref: 24 pid: 14306 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265432.222738:0:14290:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596c00/0x27274ba5bb9533fd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f029e expref: 24 pid: 14306 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265432.222770:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596c00/0x27274ba5bb9533fd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f029e expref: 24 pid: 14306 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265432.222792:0:14290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a101cdf4200) 00010000:00010000:0.0:1789265432.222798:0:14290:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537600/0x27274ba5bb95345f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265432.222809:0:14290:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537600/0x27274ba5bb95345f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265432.222817:0:14290:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265432.222890:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a104163d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a1015321-b6f2-4e27-98e4-70a40da05f32+23:2349:x1876180397578880:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 226us (1428us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265432.222898:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 11 00000100:00100000:0.0:1789265432.222962:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 12 00000100:00100000:0.0:1789265432.222969:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102efe0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a1015321-b6f2-4e27-98e4-70a40da05f32+22:2351:x1876180397579008:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265432.222979:0:14290:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265432.223710:0:14290:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537000/0x27274ba5bb953412 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f02a5 expref: 22 pid: 15928 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265432.223736:0:14290:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537000/0x27274ba5bb953412 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f02a5 expref: 22 pid: 15928 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265432.223778:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537000/0x27274ba5bb953412 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f02a5 expref: 22 pid: 15928 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265432.223794:0:14290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a101cdf4200) 00010000:00010000:0.0:1789265432.223799:0:14290:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537600/0x27274ba5bb95345f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265432.223808:0:14290:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537600/0x27274ba5bb95345f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265432.223816:0:14290:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537600/0x27274ba5bb95345f lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265432.223851:0:14290:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265432.223892:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102efe0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a1015321-b6f2-4e27-98e4-70a40da05f32+21:2351:x1876180397579008:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 923us (2231us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265432.223901:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 12 00010000:00010000:3.0:1789265432.224931:0:14305:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537600/0x27274ba5bb95345f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265432.224947:0:14305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537600/0x27274ba5bb95345f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265432.224975:0:14305:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789265432.225762:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537a00/0x27274ba5bb953458 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f02c1 expref: 22 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265432.225794:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537600/0x27274ba5bb95345f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f02c1 expref: 21 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265432.225804:0:14305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a101cdf4200) 00010000:00010000:3.0:1789265432.225823:0:14305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789265432.225827:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a102e537600, rc 0) 00000100:00100000:3.0:1789265432.227712:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102efe1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1015321-b6f2-4e27-98e4-70a40da05f32+21:14452:x1876180397578752:12345-192.168.203.37@tcp:101:dd.0 Request processed in 12212us (12520us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1789265432.227739:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 34 00000100:00100000:1.0:1789265432.230622:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265432.230791:0:15928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397579264 00000100:00100000:2.0:1789265432.231147:0:15928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397579264 00000100:00100000:2.0:1789265432.231241:0:15928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 35 00000100:00100000:2.0:1789265432.231254:0:15928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102efe2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1015321-b6f2-4e27-98e4-70a40da05f32+21:14452:x1876180397579264:12345-192.168.203.37@tcp:36:dd.0 00010000:00010000:2.0:1789265432.231627:0:15928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537800/0x27274ba5bb95346d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265432.231651:0:15928:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537800/0x27274ba5bb95346d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265432.231665:0:15928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537800/0x27274ba5bb95346d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789265432.233602:0:15928:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1789265432.233722:0:15928:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000962677d7 reply state 0000000049dece7b transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537800/0x27274ba5bb95346d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265432.233737:0:15928:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789265432.233919:0:15928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102efe2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1015321-b6f2-4e27-98e4-70a40da05f32+24:14452:x1876180397579264:12345-192.168.203.37@tcp:36:dd.0 Request processed in 2661us (3304us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1789265432.233930:0:15928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 35 00000020:00080000:2.0:1789265432.233937:0:15928:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789265432.236434:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537800/0x27274ba5bb95346d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265432.236456:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537800/0x27274ba5bb95346d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265432.236537:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537800/0x27274ba5bb95346d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265432.236545:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a102e537800 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789265432.236552:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537800/0x27274ba5bb95346d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265432.236585:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537800/0x27274ba5bb95346d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265432.236609:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a101cdf4200) 00010000:00010000:0.0:1789265432.236613:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265432.236619:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537800/0x27274ba5bb95346d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265432.236625:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537800/0x27274ba5bb95346d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265432.236785:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265432.237130:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397579392 00000100:00100000:2.0:1789265432.237143:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397579392 00000100:00100000:2.0:1789265432.237210:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 36 00000100:00100000:2.0:1789265432.237230:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1016d47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1015321-b6f2-4e27-98e4-70a40da05f32+23:14452:x1876180397579392:12345-192.168.203.37@tcp:101:dd.0 00010000:00010000:2.0:1789265432.237262:0:14306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265432.237284:0:14306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e536800/0x27274ba5bb953474 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f02c8 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265432.237360:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e536800/0x27274ba5bb953474 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f02c8 expref: 24 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265432.237376:0:14306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e536800/0x27274ba5bb953474 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f02c8 expref: 24 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265432.237396:0:14306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a101cdf4200) 00010000:00010000:2.0:1789265432.237399:0:14306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789265432.237403:0:14306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a102e536800, rc 0) 00000100:00100000:2.0:1789265432.237483:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1016d47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1015321-b6f2-4e27-98e4-70a40da05f32+24:14452:x1876180397579392:12345-192.168.203.37@tcp:101:dd.0 Request processed in 263us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265432.237490:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 36 00000100:00100000:2.0:1789265432.254477:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265432.254619:0:14291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397579648 00000100:00100000:1.0:1789265432.254631:0:14291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397579648 00000100:00100000:1.0:1789265432.255263:0:14291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 2 00000100:00100000:1.0:1789265432.255281:0:14291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10037b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1015321-b6f2-4e27-98e4-70a40da05f32+24:14452:x1876180397579648:12345-192.168.203.37@tcp:103:dd.0 00010000:00010000:1.0:1789265432.255302:0:14291:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265432.255337:0:14291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e536800/0x27274ba5bb953474 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f02c8 expref: 24 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.255363:0:14291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a101cdf4200) 00010000:00010000:1.0:1789265432.255388:0:14291:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265432.255468:0:14291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10037b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1015321-b6f2-4e27-98e4-70a40da05f32+23:14452:x1876180397579648:12345-192.168.203.37@tcp:103:dd.0 Request processed in 193us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265432.255477:0:14291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 2 00000100:00100000:0.0:1789265432.259828:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265432.260976:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397579776 00000100:00100000:1.0:1789265432.260994:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397579776 00000100:00100000:1.0:1789265432.263038:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 37 00000100:00100000:1.0:1789265432.263070:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1009071500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1015321-b6f2-4e27-98e4-70a40da05f32+23:14452:x1876180397579776:12345-192.168.203.37@tcp:58:dd.0 00010000:00010000:1.0:1789265432.263234:0:14304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596400/0x27274ba5bb95347b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.263256:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596400/0x27274ba5bb95347b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.263271:0:14304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596400/0x27274ba5bb95347b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789265432.264535:0:14304:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789265432.268265:0:14304:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1789265432.268405:0:14304:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1789265432.268608:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1009071500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1015321-b6f2-4e27-98e4-70a40da05f32+23:14452:x1876180397579776:12345-192.168.203.37@tcp:58:dd.0 Request processed in 5546us (8787us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265432.268623:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 37 00000100:00100000:3.0:1789265432.276552:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265432.276668:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397579904 00000100:00100000:2.0:1789265432.276756:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397579904 00000100:00100000:2.0:1789265432.278133:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 38 00000100:00100000:2.0:1789265432.278163:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1016d44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1015321-b6f2-4e27-98e4-70a40da05f32+23:14452:x1876180397579904:12345-192.168.203.37@tcp:101:dd.0 00010000:00010000:2.0:1789265432.278308:0:14306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265432.278340:0:14306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537a00/0x27274ba5bb953482 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f02cf expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265432.278418:0:14306:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596400/0x27274ba5bb95347b lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265432.278431:0:14306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537a00/0x27274ba5bb953482 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f02cf expref: 24 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265432.278455:0:14306:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596400/0x27274ba5bb95347b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265432.278472:0:14306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537a00/0x27274ba5bb953482 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f02cf expref: 24 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265432.278488:0:14306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a101cdf4200) 00010000:00010000:2.0:1789265432.278492:0:14306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789265432.278496:0:14306:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537a00/0x27274ba5bb953482 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f02cf expref: 24 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265432.278504:0:14306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a102e537a00, rc 0) 00000100:00100000:2.0:1789265432.279457:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1016d44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1015321-b6f2-4e27-98e4-70a40da05f32+24:14452:x1876180397579904:12345-192.168.203.37@tcp:101:dd.0 Request processed in 1302us (2906us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265432.279492:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 38 00000040:00080000:1.0:1789265432.371167:0:14336:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789265432.371175:0:14336:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789265432.371213:0:14336:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1789265432.371233:0:14336:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1789265432.371484:0:14336:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102efe0700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14336:1876180414339712:192.168.203.37@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789265432.371590:0:14336:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1008f936c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265432.377153:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265432.377414:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397580032 00000100:00100000:2.0:1789265432.377427:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397580032 00000100:00100000:1.0:1789265432.377491:0:14336:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102efe0700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14336:1876180414339712:192.168.203.37@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789265432.377501:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 0 00000100:00100000:2.0:1789265432.377516:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1016d45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a1015321-b6f2-4e27-98e4-70a40da05f32+25:14454:x1876180397580032:12345-192.168.203.37@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1789265432.377769:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1016d45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a1015321-b6f2-4e27-98e4-70a40da05f32+24:14454:x1876180397580032:12345-192.168.203.37@tcp:900:lhsmtool_posix.0 Request processed in 255us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265432.377778:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 0 00000100:00100000:2.0:1789265432.394642:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265432.397942:0:15928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397580160 00000100:00100000:3.0:1789265432.397965:0:15928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397580160 00000100:00100000:3.0:1789265432.398391:0:15928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 39 00000100:00100000:3.0:1789265432.398407:0:15928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10037b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1015321-b6f2-4e27-98e4-70a40da05f32+24:14454:x1876180397580160:12345-192.168.203.37@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789265432.398488:0:15928:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789265432.399156:0:15928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10037b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1015321-b6f2-4e27-98e4-70a40da05f32+24:14454:x1876180397580160:12345-192.168.203.37@tcp:53:lhsmtool_posix.0 Request processed in 747us (4525us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265432.399167:0:15928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 39 00000100:00100000:0.0:1789265432.403447:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265432.403817:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397580288 00000100:00100000:3.0:1789265432.403831:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397580288 00000100:00100000:3.0:1789265432.403960:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 40 00000100:00100000:3.0:1789265432.403973:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1009072d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1015321-b6f2-4e27-98e4-70a40da05f32+24:14454:x1876180397580288:12345-192.168.203.37@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789265432.404115:0:14305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a0f03142e00/0x27274ba5bb953489 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265432.404397:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a0f03142e00/0x27274ba5bb953489 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265432.404414:0:14305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a0f03142e00/0x27274ba5bb953489 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265432.404455:0:14305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a0f03143a00/0x27274ba5bb953490 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265432.404535:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a0f03143a00/0x27274ba5bb953490 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265432.404542:0:14305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a0f03143a00/0x27274ba5bb953490 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265432.404571:0:14305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a0f03142800/0x27274ba5bb953497 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265432.404580:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a0f03142800/0x27274ba5bb953497 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265432.404587:0:14305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a0f03142800/0x27274ba5bb953497 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265432.404705:0:14305:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1789265432.404710:0:14305:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789265432.404730:0:14305:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a0f03142800/0x27274ba5bb953497 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265432.404744:0:14305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a0f03142e00/0x27274ba5bb953489 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265432.404751:0:14305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a0f03142e00/0x27274ba5bb953489 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265432.404759:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a0f03142e00/0x27274ba5bb953489 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265432.404775:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a0f03142e00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789265432.404780:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a0f03142e00/0x27274ba5bb953489 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265432.404788:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a0f03142e00/0x27274ba5bb953489 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265432.404804:0:14305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a101cdf4500) 00010000:00010000:3.0:1789265432.404808:0:14305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265432.404813:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a0f03142e00/0x27274ba5bb953489 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265432.404820:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a0f03142e00/0x27274ba5bb953489 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265432.404836:0:14305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a0f03143a00/0x27274ba5bb953490 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265432.404842:0:14305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a0f03143a00/0x27274ba5bb953490 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265432.404847:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a0f03143a00/0x27274ba5bb953490 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265432.404853:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a0f03143a00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789265432.404856:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a0f03143a00/0x27274ba5bb953490 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265432.404862:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a0f03143a00/0x27274ba5bb953490 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265432.404879:0:14305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8a1012931100) 00010000:00010000:3.0:1789265432.404882:0:14305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265432.404885:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a0f03143a00/0x27274ba5bb953490 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265432.404890:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a0f03143a00/0x27274ba5bb953490 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265432.404906:0:14305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a0f03142800/0x27274ba5bb953497 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265432.404912:0:14305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a0f03142800/0x27274ba5bb953497 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265432.404918:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a0f03142800/0x27274ba5bb953497 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265432.404924:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a0f03142800 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789265432.404927:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a0f03142800/0x27274ba5bb953497 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265432.404933:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a0f03142800/0x27274ba5bb953497 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265432.404939:0:14305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a101cdf4200) 00010000:00010000:3.0:1789265432.404942:0:14305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265432.404944:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a0f03142800/0x27274ba5bb953497 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265432.404949:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a0f03142800/0x27274ba5bb953497 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265432.405557:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1009072d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1015321-b6f2-4e27-98e4-70a40da05f32+24:14454:x1876180397580288:12345-192.168.203.37@tcp:34:lhsmtool_posix.0 Request processed in 1580us (2118us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265432.405569:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 40 00000100:00100000:0.0:1789265432.408706:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265432.409524:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397580544 00000100:00100000:1.0:1789265432.409539:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397580544 00000100:00100000:1.0:1789265432.409803:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 41 00000100:00100000:1.0:1789265432.409818:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1009072680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1015321-b6f2-4e27-98e4-70a40da05f32+24:14454:x1876180397580544:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789265432.409846:0:14304:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265432.409871:0:14304:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb95349e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f02d6 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.410002:0:14304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596c00/0x27274ba5bb9534a5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.410022:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596c00/0x27274ba5bb9534a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.410036:0:14304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596c00/0x27274ba5bb9534a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265432.410049:0:14304:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789265432.410349:0:14304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596c00/0x27274ba5bb9534a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.410359:0:14304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596c00/0x27274ba5bb9534a5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.410365:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596c00/0x27274ba5bb9534a5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.410371:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b596c00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789265432.410376:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596c00/0x27274ba5bb9534a5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.410401:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596c00/0x27274ba5bb9534a5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.410417:0:14304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a101cdf4200) 00010000:00010000:1.0:1789265432.410420:0:14304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789265432.410425:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596c00/0x27274ba5bb9534a5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.410431:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596c00/0x27274ba5bb9534a5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.410553:0:14304:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb95349e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f02d6 expref: 26 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.410564:0:14304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a101cdf4500) 00010000:00010000:1.0:1789265432.410566:0:14304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789265432.410570:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb95349e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f02d6 expref: 26 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.410580:0:14304:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a101b597c00, rc 0) 00000100:00100000:1.0:1789265432.410736:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1009072680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1015321-b6f2-4e27-98e4-70a40da05f32+25:14454:x1876180397580544:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 922us (2049us total) trans 8589934611 rc 301/301 00000100:00100000:1.0:1789265432.410745:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 41 00000100:00100000:0.0:1789265432.420879:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265432.420991:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397580672 00000100:00100000:2.0:1789265432.421005:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397580672 00000100:00100000:2.0:1789265432.421129:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 42 00000100:00100000:2.0:1789265432.421142:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1009073b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1015321-b6f2-4e27-98e4-70a40da05f32+25:14454:x1876180397580672:12345-192.168.203.37@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789265432.421195:0:14306:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789265432.421380:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1009073b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1015321-b6f2-4e27-98e4-70a40da05f32+25:14454:x1876180397580672:12345-192.168.203.37@tcp:53:lhsmtool_posix.0 Request processed in 240us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265432.421390:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 42 00000100:00100000:0.0:1789265432.424506:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265432.424897:0:15928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397580928 00000100:00100000:3.0:1789265432.424910:0:15928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397580928 00000100:00100000:3.0:1789265432.424984:0:15928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 43 00000100:00100000:3.0:1789265432.424995:0:15928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1009070380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1015321-b6f2-4e27-98e4-70a40da05f32+25:14454:x1876180397580928:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789265432.425020:0:15928:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265432.425048:0:15928:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a0f03142800/0x27274ba5bb9534b3 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f02dd expref: -99 pid: 15928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789265432.431687:0:15928:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x7:0x0], count =27 00000004:00080000:2.0:1789265432.431705:0:15928:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x7:0x0]+27 in llog 00000004:00080000:2.0:1789265432.431844:0:15928:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:2.0:1789265432.432683:0:15928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e536000/0x27274ba5bb9534ba lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265432.432704:0:15928:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e536000/0x27274ba5bb9534ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265432.432718:0:15928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e536000/0x27274ba5bb9534ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265432.433680:0:15928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a0f03142800/0x27274ba5bb9534b3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f02dd expref: 28 pid: 15928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265432.433710:0:15928:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e536000/0x27274ba5bb9534ba lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f02dd expref: 27 pid: 15928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265432.433720:0:15928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a1011b38600) 00010000:00010000:2.0:1789265432.433723:0:15928:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789265432.433726:0:15928:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a102e536000, rc 0) 00000100:00100000:2.0:1789265432.434050:0:15928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1009070380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1015321-b6f2-4e27-98e4-70a40da05f32+27:14454:x1876180397580928:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 9053us (9555us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1789265432.434061:0:15928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 43 00000100:00100000:0.0:1789265432.438913:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265432.439043:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397581184 00000100:00100000:2.0:1789265432.439057:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397581184 00000100:00100000:2.0:1789265432.439153:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 44 00000100:00100000:2.0:1789265432.439166:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02e31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1015321-b6f2-4e27-98e4-70a40da05f32+27:14454:x1876180397581184:12345-192.168.203.37@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789265432.439258:0:14306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265432.439293:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e536000/0x27274ba5bb9534ba lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f02dd expref: 27 pid: 15928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265432.439315:0:14306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a1011b38600) 00010000:00010000:2.0:1789265432.439329:0:14306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789265432.439358:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537400/0x27274ba5bb9534c8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265432.439443:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537400/0x27274ba5bb9534c8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265432.439475:0:14306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537400/0x27274ba5bb9534c8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265432.439492:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e536200/0x27274ba5bb9534cf lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x54fbe601 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265432.439500:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e536200/0x27274ba5bb9534cf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x54fbe601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265432.439507:0:14306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e536200/0x27274ba5bb9534cf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x54fbe601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265432.439715:0:14306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537400/0x27274ba5bb9534c8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265432.439723:0:14306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537400/0x27274ba5bb9534c8 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265432.439729:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537400/0x27274ba5bb9534c8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265432.439735:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a102e537400 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789265432.439806:0:14306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537400/0x27274ba5bb9534c8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265432.439814:0:14306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537400/0x27274ba5bb9534c8 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265432.439823:0:14306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a1012931300) 00010000:00010000:2.0:1789265432.439826:0:14306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265432.439830:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537400/0x27274ba5bb9534c8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265432.439843:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537400/0x27274ba5bb9534c8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265432.439854:0:14306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e536200/0x27274ba5bb9534cf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x54fbe601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265432.439861:0:14306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e536200/0x27274ba5bb9534cf lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x54fbe601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265432.439867:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e536200/0x27274ba5bb9534cf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x54fbe601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265432.439872:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a102e536200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789265432.439876:0:14306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e536200/0x27274ba5bb9534cf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x54fbe601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265432.439882:0:14306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e536200/0x27274ba5bb9534cf lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x54fbe601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265432.439891:0:14306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x54fbe601 (ffff8a1011b38900) 00010000:00010000:2.0:1789265432.439894:0:14306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265432.439897:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e536200/0x27274ba5bb9534cf lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x54fbe601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265432.439902:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e536200/0x27274ba5bb9534cf lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x54fbe601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265432.440002:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02e31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1015321-b6f2-4e27-98e4-70a40da05f32+26:14454:x1876180397581184:12345-192.168.203.37@tcp:36:lhsmtool_posix.0 Request processed in 838us (1102us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789265432.440011:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 44 00000100:00100000:0.0:1789265432.448239:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265432.448415:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397581312 00000100:00100000:1.0:1789265432.448430:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397581312 00000100:00100000:1.0:1789265432.448508:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 45 00000100:00100000:1.0:1789265432.448522:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02e31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1015321-b6f2-4e27-98e4-70a40da05f32+26:14454:x1876180397581312:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789265432.448580:0:14304:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265432.448612:0:14304:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb9534d6 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f02e4 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.448660:0:14304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596c00/0x27274ba5bb9534dd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.448677:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596c00/0x27274ba5bb9534dd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.448692:0:14304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596c00/0x27274ba5bb9534dd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.449029:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb9534d6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f02e4 expref: 28 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.449052:0:14304:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596c00/0x27274ba5bb9534dd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f02e4 expref: 27 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.449062:0:14304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a101cdf4900) 00010000:00010000:1.0:1789265432.449065:0:14304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789265432.449069:0:14304:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a101b596c00, rc 0) 00000100:00100000:1.0:1789265432.449486:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02e31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1015321-b6f2-4e27-98e4-70a40da05f32+27:14454:x1876180397581312:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 964us (1269us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265432.449495:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 45 00000100:00100000:0.0:1789265432.455044:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265432.455319:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397581568 00000100:00100000:3.0:1789265432.455334:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397581568 00000100:00100000:3.0:1789265432.455419:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 46 00000100:00100000:3.0:1789265432.455432:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103ba7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1015321-b6f2-4e27-98e4-70a40da05f32+27:14454:x1876180397581568:12345-192.168.203.37@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789265432.455549:0:14305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a0f03143a00/0x27274ba5bb9534e4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265432.455886:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a0f03143a00/0x27274ba5bb9534e4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265432.455904:0:14305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a0f03143a00/0x27274ba5bb9534e4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789265432.456542:0:14305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:3.0:1789265432.456559:0:14305:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 478261483018ns, next at 479261479905ns, rc = 0 00000004:00010000:3.0:1789265432.456969:0:14305:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000acbea115 reply state 00000000898fe4c1 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8a0f03143a00/0x27274ba5bb9534e4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265432.457002:0:14305:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789265432.457517:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103ba7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1015321-b6f2-4e27-98e4-70a40da05f32+29:14454:x1876180397581568:12345-192.168.203.37@tcp:36:lhsmtool_posix.0 Request processed in 2082us (2483us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1789265432.457532:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 46 00000100:00100000:0.0:1789265432.460596:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265432.461006:0:15928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397581696 00000100:00100000:3.0:1789265432.461021:0:15928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397581696 00000100:00100000:3.0:1789265432.461170:0:15928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 47 00000100:00100000:3.0:1789265432.461183:0:15928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102eecc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1015321-b6f2-4e27-98e4-70a40da05f32+29:14454:x1876180397581696:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789265432.461217:0:15928:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265432.461256:0:15928:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a0f03142e00/0x27274ba5bb9534eb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f02eb expref: -99 pid: 15928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265432.461344:0:15928:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a0f03142e00/0x27274ba5bb9534eb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f02eb expref: 30 pid: 15928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265432.461363:0:15928:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a0f03142e00/0x27274ba5bb9534eb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f02eb expref: 30 pid: 15928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265432.461403:0:15928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a101cdf4900) 00010000:00010000:3.0:1789265432.461407:0:15928:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789265432.461412:0:15928:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a0f03142e00, rc 0) 00000100:00100000:3.0:1789265432.461622:0:15928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102eecc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1015321-b6f2-4e27-98e4-70a40da05f32+30:14454:x1876180397581696:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 431us (1029us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265432.461635:0:15928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 47 00010000:00010000:2.0:1789265432.465937:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a0f03143a00/0x27274ba5bb9534e4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265432.465960:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a0f03143a00/0x27274ba5bb9534e4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265432.465970:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a0f03143a00/0x27274ba5bb9534e4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265432.465977:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a0f03143a00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789265432.465983:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a0f03143a00/0x27274ba5bb9534e4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265432.465993:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a0f03143a00/0x27274ba5bb9534e4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265432.466018:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a101cdf4900) 00010000:00010000:2.0:1789265432.466022:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789265432.466028:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a0f03143a00/0x27274ba5bb9534e4 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265432.466035:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a0f03143a00/0x27274ba5bb9534e4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265432.470707:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265432.472906:0:14989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397581824 00000100:00100000:2.0:1789265432.472926:0:14989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397581824 00000100:00100000:2.0:1789265432.473009:0:14989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 12 00000100:00100000:2.0:1789265432.473021:0:14989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102eecd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1015321-b6f2-4e27-98e4-70a40da05f32+5:2350:x1876180397581824:12345-192.168.203.37@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789265432.473690:0:14989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102eecd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1015321-b6f2-4e27-98e4-70a40da05f32+6:2350:x1876180397581824:12345-192.168.203.37@tcp:2:lhsmtool_posix.0 Request processed in 540us (2868us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1789265432.473704:0:14989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 12 00000100:00100000:0.0:1789265432.477207:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265432.477674:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397582080 00000100:00100000:2.0:1789265432.477688:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397582080 00000100:00100000:2.0:1789265432.477776:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 9 00000100:00100000:2.0:1789265432.477789:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c07a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1015321-b6f2-4e27-98e4-70a40da05f32+29:14454:x1876180397582080:12345-192.168.203.37@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789265432.478309:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c07a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1015321-b6f2-4e27-98e4-70a40da05f32+30:14454:x1876180397582080:12345-192.168.203.37@tcp:35:lhsmtool_posix.0 Request processed in 520us (1112us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1789265432.478319:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 9 00000100:00100000:3.0:1789265432.483334:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265432.484262:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397582336 00000100:00100000:2.0:1789265432.484278:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397582336 00000100:00100000:2.0:1789265432.484369:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 48 00000100:00100000:2.0:1789265432.484382:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1016d44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1015321-b6f2-4e27-98e4-70a40da05f32+30:14454:x1876180397582336:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789265432.485067:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1016d44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1015321-b6f2-4e27-98e4-70a40da05f32+30:14454:x1876180397582336:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 Request processed in 682us (1744us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265432.485130:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 48 00000100:00100000:0.0:1789265432.508693:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265432.509525:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397582464 00000100:00100000:1.0:1789265432.509541:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397582464 00000100:00100000:1.0:1789265432.509635:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 49 00000100:00100000:1.0:1789265432.509648:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c07b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1015321-b6f2-4e27-98e4-70a40da05f32+30:14454:x1876180397582464:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789265432.509894:0:14304:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265432.509923:0:14304:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb9534f2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f02f2 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.510058:0:14304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597000/0x27274ba5bb9534f9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.510838:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597000/0x27274ba5bb9534f9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.510859:0:14304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597000/0x27274ba5bb9534f9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265432.510914:0:14304:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789265432.510943:0:14304:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597000/0x27274ba5bb9534f9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.510996:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb9534f2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f02f2 expref: 32 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.511022:0:14304:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597000/0x27274ba5bb9534f9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f02f2 expref: 31 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.511032:0:14304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a101cdf4900) 00010000:00010000:1.0:1789265432.511035:0:14304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789265432.511039:0:14304:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a101b597000, rc 0) 00000100:00100000:1.0:1789265432.513602:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c07b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1015321-b6f2-4e27-98e4-70a40da05f32+31:14454:x1876180397582464:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 3940us (4907us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265432.513617:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 49 00000100:00100000:0.0:1789265432.522199:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265432.522577:0:14990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397582592 00000100:00100000:3.0:1789265432.522609:0:14990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397582592 00000100:00100000:3.0:1789265432.522853:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 13 00000100:00100000:3.0:1789265432.522867:0:14990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c079c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1015321-b6f2-4e27-98e4-70a40da05f32+6:2351:x1876180397582592:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789265432.522892:0:14990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265432.522919:0:14990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe71cfb3/0x27274ba5bb953500 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f02f9 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789265432.522954:0:14990:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa60618, blocks: 0x1 00010000:00010000:3.0:1789265432.522979:0:14990:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=478s v=(0 0) 00010000:00010000:3.0:1789265432.523480:0:14990:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265432.523498:0:14990:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe71cfb3/0x27274ba5bb953500 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f02f9 expref: 7 pid: 14990 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265432.523526:0:14990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fe71cfb3/0x27274ba5bb953500 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f02f9 expref: 7 pid: 14990 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265432.523544:0:14990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a0f03143800, rc 0) 00000100:00100000:3.0:1789265432.523617:0:14990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c079c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1015321-b6f2-4e27-98e4-70a40da05f32+7:2351:x1876180397582592:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 753us (1441us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265432.523625:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 13 00000100:00100000:3.0:1789265432.535286:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265432.535464:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397582848 00000100:00100000:0.0:1789265432.535531:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397582848 00000100:00100000:0.0:1789265432.535673:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 50 00000100:00100000:0.0:1789265432.535696:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1015321-b6f2-4e27-98e4-70a40da05f32+31:14454:x1876180397582848:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789265432.535869:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1015321-b6f2-4e27-98e4-70a40da05f32+31:14454:x1876180397582848:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 Request processed in 185us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265432.535877:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 50 00000100:00100000:0.0:1789265432.541434:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265432.541624:0:15928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397582976 00000100:00100000:3.0:1789265432.541637:0:15928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397582976 00000100:00100000:3.0:1789265432.541884:0:15928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 51 00000100:00100000:3.0:1789265432.541898:0:15928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c078700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1015321-b6f2-4e27-98e4-70a40da05f32+31:14454:x1876180397582976:12345-192.168.203.37@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789265432.655337:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934607 is committed 00000001:00080000:3.0:1789265432.655380:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934611 is committed 00000001:00080000:3.0:1789265432.655396:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934597 is committed 00000001:00080000:3.0:1789265432.655415:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000001:00080000:3.0:1789265432.655435:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000004:00080000:3.0:1789265432.655455:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:3.0:1789265432.655471:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:1.0:1789265432.655794:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789265432.656893:0:15928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c078700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1015321-b6f2-4e27-98e4-70a40da05f32+14:14454:x1876180397582976:12345-192.168.203.37@tcp:44:lhsmtool_posix.0 Request processed in 114992us (115467us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265432.656905:0:15928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 51 00000100:00100000:1.0:1789265432.658835:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414339840:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789265432.658908:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265432.659123:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414339840 00000100:00100000:0.0:1789265432.659133:0:14987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414339840 00000100:00100000:0.0:1789265432.659189:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789265432.659198:0:14987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102efe0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414339840:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1789265432.659381:0:14987:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1789265432.659385:0:14987:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1789265432.659387:0:14987:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789265432.659389:0:14987:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1789265432 -> 1789265432 00002000:00010000:0.0:1789265432.659391:0:14987:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789265432.659442:0:14987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102efe0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3316:x1876180414339840:12345-0@lo:2:osp-syn-1-0.0 Request processed in 244us (533us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1789265432.659449:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789265432.659803:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00080000:2.0:1789265432.659936:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1789265432.660115:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a0f02da3b80/2, rc 0, transno 8589934595 00000100:00100000:1.0:1789265432.660123:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414339840:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789265432.660211:0:14989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397583104 00000100:00100000:3.0:1789265432.660217:0:14989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397583104 00000100:00100000:3.0:1789265432.660265:0:14989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 15 00000100:00100000:3.0:1789265432.660274:0:14989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c079880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1015321-b6f2-4e27-98e4-70a40da05f32+7:2350:x1876180397583104:12345-192.168.203.37@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1789265432.660361:0:14989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c079880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1015321-b6f2-4e27-98e4-70a40da05f32+7:2350:x1876180397583104:12345-192.168.203.37@tcp:16:lhsmtool_posix.0 Request processed in 87us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265432.660368:0:14989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 15 00000100:00100000:3.0:1789265432.664870:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265432.665012:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397583360 00000100:00100000:2.0:1789265432.665022:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397583360 00000100:00100000:2.0:1789265432.665116:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 52 00000100:00100000:2.0:1789265432.665126:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1015321-b6f2-4e27-98e4-70a40da05f32+14:14454:x1876180397583360:12345-192.168.203.37@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789265432.665177:0:14306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265432.665205:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597000/0x27274ba5bb9534f9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f02f2 expref: 14 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265432.665248:0:14306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a101cdf4900) 00010000:00010000:2.0:1789265432.665252:0:14306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789265432.665281:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537400/0x27274ba5bb953507 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265432.665295:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537400/0x27274ba5bb953507 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265432.665304:0:14306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537400/0x27274ba5bb953507 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789265432.665495:0:14306:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b160151e reply state 00000000722fc722 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537400/0x27274ba5bb953507 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265432.665504:0:14306:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789265432.665814:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1015321-b6f2-4e27-98e4-70a40da05f32+15:14454:x1876180397583360:12345-192.168.203.37@tcp:36:lhsmtool_posix.0 Request processed in 687us (950us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1789265432.665823:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 52 00010000:00010000:1.0:1789265432.672345:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537400/0x27274ba5bb953507 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.672369:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537400/0x27274ba5bb953507 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.672377:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537400/0x27274ba5bb953507 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.672386:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a102e537400 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789265432.672391:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537400/0x27274ba5bb953507 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.672402:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537400/0x27274ba5bb953507 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.672419:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a101cdf4900) 00010000:00010000:1.0:1789265432.672422:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265432.672426:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537400/0x27274ba5bb953507 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.672432:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537400/0x27274ba5bb953507 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265432.672675:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265432.673970:0:14990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397583488 00000100:00100000:3.0:1789265432.673982:0:14990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397583488 00000100:00100000:3.0:1789265432.674135:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 16 00000100:00100000:3.0:1789265432.674147:0:14990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10037b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1015321-b6f2-4e27-98e4-70a40da05f32+7:14454:x1876180397583488:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789265432.674166:0:14990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265432.674183:0:14990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ffc8682/0x27274ba5bb95350e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x73b61075d99f0300 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265432.674232:0:14990:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fe71cfb3/0x27274ba5bb953500 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f02f9 expref: 8 pid: 14990 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265432.674242:0:14990:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265432.674246:0:14990:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265432.674266:0:14990:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ffc8682/0x27274ba5bb95350e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0300 expref: 8 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265432.674310:0:14990:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fe71cfb3/0x27274ba5bb953500 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f02f9 expref: 8 pid: 14990 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265432.674326:0:14990:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fe71cfb3/0x27274ba5bb953500 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f02f9 expref: 8 pid: 14990 timeout: 578 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265432.674341:0:14990:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:14990:1876180414339968:192.168.203.37@tcp:104: 00000100:00100000:3.0:1789265432.674634:0:14990:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a101878fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789265432.677496:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265432.677634:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397583616 00000100:00100000:3.0:1789265432.677643:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397583616 00010000:00010000:3.0:1789265432.677690:0:14289:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fe71cfb3/0x27274ba5bb953500 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f02f9 expref: 9 pid: 14990 timeout: 578 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265432.677735:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 13 00000100:00100000:3.0:1789265432.677745:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10037b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1015321-b6f2-4e27-98e4-70a40da05f32+9:2351:x1876180397583616:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265432.677759:0:14289:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265432.677782:0:14289:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fe71cfb3/0x27274ba5bb953500 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f02f9 expref: 9 pid: 14990 timeout: 578 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265432.677810:0:14289:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fe71cfb3/0x27274ba5bb953500 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f02f9 expref: 9 pid: 14990 timeout: 578 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265432.677835:0:14289:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265432.677847:0:14289:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265432.677854:0:14289:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001ffc8682/0x27274ba5bb95350e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0300 expref: 9 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265432.677865:0:14289:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ffc8682/0x27274ba5bb95350e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0300 expref: 9 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265432.677914:0:14289:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001ffc8682/0x27274ba5bb95350e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0300 expref: 9 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265432.677929:0:14289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a0f02da1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14289:1876180414340096:192.168.203.37@tcp:105: 00000100:00100000:3.0:1789265432.678014:0:14289:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a101878f840 going to sleep for 11 seconds 00000100:00100000:1.0:1789265432.682302:0:14289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14289:1876180414340096:192.168.203.37@tcp:105: 00010000:00010000:1.0:1789265432.682337:0:14289:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265432.682415:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10037b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1015321-b6f2-4e27-98e4-70a40da05f32+9:2351:x1876180397583616:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 4670us (4925us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265432.682428:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 13 00010000:00010000:0.0:1789265432.686522:0:14990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe71cfb3/0x27274ba5bb953500 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f02f9 expref: 8 pid: 14990 timeout: 578 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265432.686548:0:14990:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a0f02da2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:14990:1876180414339968:192.168.203.37@tcp:104: 00010000:00010000:0.0:1789265432.686631:0:14990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001ffc8682/0x27274ba5bb95350e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0300 expref: 7 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265432.686648:0:14990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a0f03142200, rc 0) 00000100:00100000:1.0:1789265432.687050:0:14990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10037b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1015321-b6f2-4e27-98e4-70a40da05f32+7:14454:x1876180397583488:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 12903us (14377us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265432.687062:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 16 00000100:00100000:3.0:1789265432.690498:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265432.692955:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397583744 00000100:00100000:0.0:1789265432.692971:0:14987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397583744 00000100:00100000:0.0:1789265432.693045:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 17 00000100:00100000:0.0:1789265432.693057:0:14987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1015321-b6f2-4e27-98e4-70a40da05f32+7:2350:x1876180397583744:12345-192.168.203.37@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789265432.695529:0:14987:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789265432.695548:0:14987:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1789265432 00002000:00010000:1.0:1789265432.695551:0:14987:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1789265431 00002000:00010000:1.0:1789265432.695553:0:14987:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1789265432 -> 1789265432 00002000:00010000:1.0:1789265432.695555:0:14987:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789265432.695632:0:14987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1015321-b6f2-4e27-98e4-70a40da05f32+8:2350:x1876180397583744:12345-192.168.203.37@tcp:2:lhsmtool_posix.0 Request processed in 2572us (5139us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1789265432.695642:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 17 00000100:00100000:0.0:1789265432.703227:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265432.704763:0:14990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397583872 00000100:00100000:1.0:1789265432.704777:0:14990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397583872 00000100:00100000:1.0:1789265432.704848:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 18 00000100:00100000:1.0:1789265432.704859:0:14990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c078a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1015321-b6f2-4e27-98e4-70a40da05f32+8:2348:x1876180397583872:12345-192.168.203.37@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789265432.704905:0:14990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002b967bae/0x27274ba5bb953515 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.704926:0:14990:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001ffc8682/0x27274ba5bb95350e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0300 expref: 8 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.704935:0:14990:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265432.704939:0:14990:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789265432.705002:0:14990:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b967bae/0x27274ba5bb953515 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.705038:0:14990:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001ffc8682/0x27274ba5bb95350e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0300 expref: 8 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.705054:0:14990:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001ffc8682/0x27274ba5bb95350e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0300 expref: 8 pid: 14990 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265432.705068:0:14990:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102efe0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:14990:1876180414340224:192.168.203.37@tcp:104: 00000100:00100000:1.0:1789265432.705198:0:14990:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1008f93cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265432.708133:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265432.708190:0:14291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397584000 00000100:00100000:0.0:1789265432.708200:0:14291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397584000 00010000:00010000:0.0:1789265432.708248:0:14291:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001ffc8682/0x27274ba5bb95350e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0300 expref: 9 pid: 14990 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265432.708296:0:14291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 14 00000100:00100000:0.0:1789265432.708306:0:14291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1015321-b6f2-4e27-98e4-70a40da05f32+9:2351:x1876180397584000:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265432.708321:0:14291:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265432.708342:0:14291:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001ffc8682/0x27274ba5bb95350e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0300 expref: 9 pid: 14990 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265432.708358:0:14291:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001ffc8682/0x27274ba5bb95350e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0300 expref: 9 pid: 14990 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265432.708433:0:14990:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102efe0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:14990:1876180414340224:192.168.203.37@tcp:104: 00010000:00010000:0.0:1789265432.708863:0:14291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ffc8682/0x27274ba5bb95350e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f0300 expref: 9 pid: 14990 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.708983:0:14990:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002b967bae/0x27274ba5bb953515 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265432.714164:0:14291:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789265432.714176:0:14291:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789265432.714186:0:14291:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002b967bae/0x27274ba5bb953515 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265432.714233:0:14291:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b967bae/0x27274ba5bb953515 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265432.714265:0:14291:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265432.714353:0:14291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1015321-b6f2-4e27-98e4-70a40da05f32+8:2351:x1876180397584000:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 6045us (6225us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265432.714363:0:14291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 14 00010000:00010000:1.0:1789265432.716230:0:14990:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002b967bae/0x27274ba5bb953515 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.716252:0:14990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b967bae/0x27274ba5bb953515 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.716288:0:14990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002b967bae/0x27274ba5bb953515 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.716298:0:14990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002b967bae/0x27274ba5bb953515 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.716326:0:14990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002b967bae/0x27274ba5bb953515 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.716334:0:14990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b597a00 already unused, calling callback (ffffffffc1581350) 00010000:00010000:1.0:1789265432.716338:0:14990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002b967bae/0x27274ba5bb953515 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.716347:0:14990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002b967bae/0x27274ba5bb953515 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.716365:0:14990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002b967bae/0x27274ba5bb953515 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.716384:0:14990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b967bae/0x27274ba5bb953515 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265432.716488:0:14990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c078a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1015321-b6f2-4e27-98e4-70a40da05f32+7:2348:x1876180397583872:12345-192.168.203.37@tcp:1:lhsmtool_posix.0 Request processed in 11626us (13407us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265432.716499:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 18 00000100:00100000:3.0:1789265432.722292:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265432.722810:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397584256 00000100:00100000:0.0:1789265432.722820:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397584256 00000100:00100000:0.0:1789265432.722881:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 53 00000100:00100000:0.0:1789265432.722892:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1015321-b6f2-4e27-98e4-70a40da05f32+14:14454:x1876180397584256:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789265432.722972:0:14304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35000/0x27274ba5bb95351c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265432.722990:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35000/0x27274ba5bb95351c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265432.723003:0:14304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35000/0x27274ba5bb95351c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265432.723330:0:14304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35800/0x27274ba5bb953523 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265432.723343:0:14304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a0f03142e00/0x27274ba5bb9534eb lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f02eb expref: 15 pid: 15928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265432.723351:0:14304:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35800/0x27274ba5bb953523 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265432.723395:0:14304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a0f03142e00/0x27274ba5bb9534eb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f02eb expref: 15 pid: 15928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265432.723412:0:14304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a0f03142e00/0x27274ba5bb9534eb lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f02eb expref: 15 pid: 15928 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265432.723427:0:14304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c07ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14304:1876180414340352:192.168.203.37@tcp:104: 00000100:00100000:0.0:1789265432.723519:0:14304:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1011abe000 going to sleep for 11 seconds 00000100:00100000:0.0:1789265432.730151:0:14304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c07ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14304:1876180414340352:192.168.203.37@tcp:104: 00010000:00010000:0.0:1789265432.730182:0:14304:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35800/0x27274ba5bb953523 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265432.730880:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265432.732178:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397584384 00000100:00100000:1.0:1789265432.732191:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397584384 00010000:00010000:1.0:1789265432.732244:0:14289:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a0f03142e00/0x27274ba5bb9534eb lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f02eb expref: 16 pid: 15928 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265432.732292:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 15 00000100:00100000:1.0:1789265432.732339:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a0f02da1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1015321-b6f2-4e27-98e4-70a40da05f32+16:2350:x1876180397584384:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265432.732355:0:14289:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265432.732363:0:14289:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a0f03142e00/0x27274ba5bb9534eb lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f02eb expref: 16 pid: 15928 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.732379:0:14289:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a0f03142e00/0x27274ba5bb9534eb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f02eb expref: 16 pid: 15928 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.732401:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a0f03142e00/0x27274ba5bb9534eb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.37@tcp remote: 0x73b61075d99f02eb expref: 16 pid: 15928 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.732418:0:14289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a101cdf4900) 00010000:00010000:1.0:1789265432.732423:0:14289:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35800/0x27274ba5bb953523 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.732433:0:14289:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35800/0x27274ba5bb953523 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.732441:0:14289:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35800/0x27274ba5bb953523 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.732473:0:14289:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265432.732542:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1015321-b6f2-4e27-98e4-70a40da05f32+15:2350:x1876180397584384:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 207us (1665us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265432.732550:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 15 00010000:00010000:0.0:1789265432.733641:0:14304:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35800/0x27274ba5bb953523 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265432.733655:0:14304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35800/0x27274ba5bb953523 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789265432.733843:0:14304:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:0.0:1789265432.733995:0:14304:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:0.0:1789265432.734045:0:14304:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:0.0:1789265432.734188:0:14304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c07ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14304:1876180414340480:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789265432.734291:0:14304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265432.734384:0:14304:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1011abe840 going to sleep for 11 seconds 00000100:00100000:2.0:1789265432.735942:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414340480 00000100:00100000:2.0:1789265432.735955:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414340480 00000100:00100000:2.0:1789265432.736015:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789265432.736033:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c078e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14304:x1876180414340480:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789265432.736173:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c078e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14304:x1876180414340480:12345-0@lo:1000:mdt00_000.0 Request processed in 149us (1882us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265432.736180:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789265432.736288:0:14304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c07ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14304:1876180414340480:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1789265432.736970:0:14304:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:0.0:1789265432.737049:0:14304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c07ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14304:1876180414340608:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789265432.737145:0:14304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265432.737177:0:14304:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1011abe000 going to sleep for 11 seconds 00000100:00100000:2.0:1789265432.737313:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414340608 00000100:00100000:2.0:1789265432.737325:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414340608 00000100:00100000:2.0:1789265432.737352:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789265432.737360:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c078380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14304:x1876180414340608:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789265432.737532:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c078380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14304:x1876180414340608:12345-0@lo:1000:mdt00_000.0 Request processed in 171us (387us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1789265432.737539:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789265432.737897:0:14304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c07ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14304:1876180414340608:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1789265432.737932:0:14304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35800/0x27274ba5bb953523 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265432.737943:0:14304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35800/0x27274ba5bb953523 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265432.737950:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35800/0x27274ba5bb953523 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265432.737956:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fa35800 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789265432.737960:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35800/0x27274ba5bb953523 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265432.737967:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35800/0x27274ba5bb953523 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265432.737982:0:14304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a101cdf4900) 00010000:00010000:0.0:1789265432.737985:0:14304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789265432.737989:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35800/0x27274ba5bb953523 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265432.737994:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35800/0x27274ba5bb953523 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265432.738022:0:14304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596400/0x27274ba5bb95347b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265432.738027:0:14304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596400/0x27274ba5bb95347b lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265432.738041:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596400/0x27274ba5bb95347b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265432.738046:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b596400 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789265432.738049:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596400/0x27274ba5bb95347b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265432.738055:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596400/0x27274ba5bb95347b lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265432.738063:0:14304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a101cdf4200) 00010000:00010000:0.0:1789265432.738065:0:14304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789265432.738072:0:14304:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537a00/0x27274ba5bb953482 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f02cf expref: 18 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265432.738117:0:14304:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537a00/0x27274ba5bb953482 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f02cf expref: 18 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265432.738126:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537a00/0x27274ba5bb953482 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f02cf expref: 18 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265432.738154:0:14304:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a102e537a00/0x27274ba5bb953482 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x73b61075d99f02cf expref: 18 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265432.738166:0:14304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a103c079500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14304:1876180414340736:192.168.203.37@tcp:105: 00000100:00100000:0.0:1789265432.738240:0:14304:0:(client.c:2715:ptlrpc_set_wait()) set ffff8a1011abe000 going to sleep for 11 seconds 00000100:00100000:0.0:1789265432.743028:0:14304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a103c079500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14304:1876180414340736:192.168.203.37@tcp:105: 00010000:00010000:0.0:1789265432.743135:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596400/0x27274ba5bb95347b lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265432.743148:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b596400/0x27274ba5bb95347b lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.743229:0:14304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb95352a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.743245:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb95352a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.743267:0:14304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb95352a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.743280:0:14304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb95352a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.743287:0:14304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb95352a lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.743294:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb95352a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.743301:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b597a00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789265432.743306:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb95352a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.743313:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb95352a lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.743325:0:14304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a101cdf4200) 00010000:00010000:1.0:1789265432.743328:0:14304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265432.743331:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb95352a lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.743337:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597a00/0x27274ba5bb95352a lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.743352:0:14304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35000/0x27274ba5bb95351c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.743358:0:14304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35000/0x27274ba5bb95351c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.743371:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35000/0x27274ba5bb95351c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.743376:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fa35000 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789265432.743379:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35000/0x27274ba5bb95351c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.743386:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35000/0x27274ba5bb95351c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.743395:0:14304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a101cdf4200) 00010000:00010000:1.0:1789265432.743397:0:14304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789265432.743400:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35000/0x27274ba5bb95351c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.743405:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a103fa35000/0x27274ba5bb95351c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265432.743624:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a0f02da2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1015321-b6f2-4e27-98e4-70a40da05f32+18:14454:x1876180397584256:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 Request processed in 20733us (21340us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1789265432.743633:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 53 00000020:00080000:1.0:1789265432.743639:0:14304:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1789265432.745531:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265432.745618:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397584640 00000100:00100000:1.0:1789265432.745629:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397584640 00000100:00100000:1.0:1789265432.745686:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 10 00000100:00100000:1.0:1789265432.745696:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a101876dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1015321-b6f2-4e27-98e4-70a40da05f32+18:14454:x1876180397584640:12345-192.168.203.37@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789265432.747932:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265432.748012:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397584768 00000100:00100000:3.0:1789265432.748022:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397584768 00000100:00100000:3.0:1789265432.748068:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 11 00000100:00100000:3.0:1789265432.748162:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10037b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1015321-b6f2-4e27-98e4-70a40da05f32+20:14452:x1876180397584768:12345-192.168.203.37@tcp:49:dd.0 00000100:00100000:3.0:1789265432.748293:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10037b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1015321-b6f2-4e27-98e4-70a40da05f32+20:14452:x1876180397584768:12345-192.168.203.37@tcp:49:dd.0 Request processed in 217us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265432.748301:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 11 00000040:00080000:0.0:1789265432.748855:0:14336:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789265432.748862:0:14336:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789265432.748895:0:14336:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1789265432.748903:0:14336:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000004:00080000:1.0:1789265432.749436:0:14308:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789265432.749552:0:14308:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:1.0:1789265432.749624:0:14308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb953531 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.749640:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb953531 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.749651:0:14308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb953531 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.749661:0:14308:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb953531 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.749667:0:14308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb953531 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.749672:0:14308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb953531 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.749695:0:14308:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789265432.749779:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a101876dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1015321-b6f2-4e27-98e4-70a40da05f32+20:14454:x1876180397584640:12345-192.168.203.37@tcp:35:lhsmtool_posix.0 Request processed in 4082us (4253us total) trans 8589934622 rc 0/0 00000100:00100000:1.0:1789265432.749787:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 10 00000020:00080000:1.0:1789265432.749791:0:14308:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789265432.751204:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265432.751216:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb953531 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265432.751238:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b597c00 already unused, calling callback (ffffffffc1581350) 00010000:00010000:2.0:1789265432.751243:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb953531 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265432.751252:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb953531 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265432.751268:0:14293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a101cdf4900) 00010000:00010000:2.0:1789265432.751270:0:14293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789265432.751275:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb953531 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265432.751281:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a101b597c00/0x27274ba5bb953531 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265432.751296:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265432.751298:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265432.751300:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265432.937534:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789265432.937603:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265432.937874:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397584896 00000100:00100000:0.0:1789265432.937883:0:14993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397584896 00000100:00100000:0.0:1789265432.937945:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397585024 00000100:00100000:0.0:1789265432.937949:0:14993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397585024 00000100:00100000:0.0:1789265432.937968:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 0 00000100:00100000:0.0:1789265432.937977:0:14993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10037b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a1015321-b6f2-4e27-98e4-70a40da05f32+8:2349:x1876180397584896:12345-192.168.203.37@tcp:4:dd.0 00002000:00010000:0.0:1789265432.938023:0:14993:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6aa60618, atime: 0x6aa60617, ctime: 0x6aa60618, blocks: 0x1 00010000:00010000:0.0:1789265432.938033:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083f016a2/0x27274ba5bb953538 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265432.938049:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=478s v=(0 0) 00010000:00010000:0.0:1789265432.938054:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265432.938060:0:14993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083f016a2/0x27274ba5bb953538 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265432.938104:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083f016a2/0x27274ba5bb953538 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265432.943818:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265432.943861:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789265432.943911:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265432.943979:0:14995:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1789265432.943988:0:14995:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:2.0:1789265432.944107:0:14994:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1789265432.944123:0:14994:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397585280 00000100:00100000:2.0:1789265432.944131:0:14994:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397585280 00000100:00100000:2.0:1789265432.944176:0:14994:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1789265432.944182:0:14994:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397585152 00000100:00100000:2.0:1789265432.944189:0:14994:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397585152 00000100:00100000:2.0:1789265432.944203:0:14994:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1789265432.944207:0:14994:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397585408 00000100:00100000:2.0:1789265432.944210:0:14994:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397585408 00000100:00100000:1.0:1789265432.944886:0:16540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 1 00000100:00100000:1.0:1789265432.944899:0:16540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10037b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a1015321-b6f2-4e27-98e4-70a40da05f32+12:2349:x1876180397585024:12345-192.168.203.37@tcp:4:dd.0 00010000:00010000:1.0:1789265432.944933:0:16540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b967bae/0x27274ba5bb95353f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.944961:0:16540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265432.944965:0:16540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265432.944972:0:16540:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b967bae/0x27274ba5bb95353f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265432.944987:0:16540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b967bae/0x27274ba5bb95353f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265432.946441:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265432.946474:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265432.946517:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265432.946532:0:14995:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1789265432.946547:0:14995:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:2.0:1789265432.946666:0:14994:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1789265432.946676:0:14994:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397585664 00000100:00100000:2.0:1789265432.946684:0:14994:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397585664 00000100:00100000:2.0:1789265432.946730:0:14994:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1789265432.946736:0:14994:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397585536 00000100:00100000:2.0:1789265432.946739:0:14994:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397585536 00000100:00100000:2.0:1789265432.946752:0:14994:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1789265432.946757:0:14994:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397585792 00000100:00100000:2.0:1789265432.946760:0:14994:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397585792 00000100:00100000:2.0:1789265432.948210:0:16541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 2 00000100:00100000:2.0:1789265432.948237:0:16541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102efe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a1015321-b6f2-4e27-98e4-70a40da05f32+15:2348:x1876180397585280:12345-192.168.203.37@tcp:4:dd.0 00010000:00010000:2.0:1789265432.949458:0:16541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009164d5b5/0x27274ba5bb953546 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265432.949480:0:16541:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265432.949484:0:16541:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265432.949491:0:16541:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009164d5b5/0x27274ba5bb953546 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265432.949508:0:16541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009164d5b5/0x27274ba5bb953546 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265433.010317:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789265433.071594:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934595 is committed 00000001:00080000:2.0:1789265433.071613:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934596 is committed 00000001:00080000:2.0:1789265433.071619:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000001:00080000:2.0:1789265433.071629:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00002000:00010000:0.0:1789265433.072180:0:14993:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:0.0:1789265433.072185:0:14993:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1789265432 -> 1789265433 00002000:00010000:0.0:1789265433.072188:0:14993:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1789265432 -> 1789265433 00002000:00010000:0.0:1789265433.072190:0:14993:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:0.0:1789265433.072204:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083f016a2/0x27274ba5bb953538 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265433.072227:0:14993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000083f016a2/0x27274ba5bb953538 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265433.072236:0:14993:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000083f016a2/0x27274ba5bb953538 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265433.072244:0:14993:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fa35800 already unused, calling callback (ffffffffc1581350) 00010000:00010000:0.0:1789265433.072250:0:14993:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000083f016a2/0x27274ba5bb953538 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265433.072258:0:14993:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000083f016a2/0x27274ba5bb953538 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265433.072279:0:14993:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000083f016a2/0x27274ba5bb953538 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265433.072287:0:14993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083f016a2/0x27274ba5bb953538 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265433.072384:0:14993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10037b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a1015321-b6f2-4e27-98e4-70a40da05f32+18:2349:x1876180397584896:12345-192.168.203.37@tcp:4:dd.0 Request processed in 134402us (134854us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1789265433.072405:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 0 00000100:00100000:0.0:1789265433.072438:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 3 00000100:00100000:0.0:1789265433.072468:0:14993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102efe0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a1015321-b6f2-4e27-98e4-70a40da05f32+17:2348:x1876180397585152:12345-192.168.203.37@tcp:4:dd.0 00010000:00010000:0.0:1789265433.072499:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004241582/0x27274ba5bb95354d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265433.072513:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265433.072517:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265433.072524:0:14993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004241582/0x27274ba5bb95354d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265433.072536:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004241582/0x27274ba5bb95354d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789265433.072688:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1789265433.144723:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:2.0:1789265433.144751:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:0.0:1789265433.144938:0:16541:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 2051 -> 6151 00010000:00010000:0.0:1789265433.144965:0:16541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009164d5b5/0x27274ba5bb953546 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265433.144982:0:16541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009164d5b5/0x27274ba5bb953546 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265433.144993:0:16541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009164d5b5/0x27274ba5bb953546 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265433.145002:0:16541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a102e537c00 already unused, calling callback (ffffffffc1581350) 00010000:00010000:0.0:1789265433.145009:0:16541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009164d5b5/0x27274ba5bb953546 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265433.145043:0:16541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009164d5b5/0x27274ba5bb953546 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265433.145103:0:16541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009164d5b5/0x27274ba5bb953546 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265433.145114:0:16541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009164d5b5/0x27274ba5bb953546 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265433.145272:0:16541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102efe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a1015321-b6f2-4e27-98e4-70a40da05f32+15:2348:x1876180397585280:12345-192.168.203.37@tcp:4:dd.0 Request processed in 197032us (201456us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1789265433.145285:0:16541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 2 00010000:00010000:1.0:1789265433.145320:0:16540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b967bae/0x27274ba5bb95353f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265433.145333:0:16541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 4 00010000:00010000:1.0:1789265433.145347:0:16540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002b967bae/0x27274ba5bb95353f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265433.145358:0:16541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102efe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a1015321-b6f2-4e27-98e4-70a40da05f32+14:2348:x1876180397585408:12345-192.168.203.37@tcp:4:dd.0 00010000:00010000:1.0:1789265433.145361:0:16540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002b967bae/0x27274ba5bb95353f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265433.145376:0:16540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b597a00 already unused, calling callback (ffffffffc1581350) 00010000:00010000:1.0:1789265433.145381:0:16540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002b967bae/0x27274ba5bb95353f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265433.145392:0:16540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002b967bae/0x27274ba5bb95353f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265433.145514:0:16540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002b967bae/0x27274ba5bb95353f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265433.145535:0:16540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b967bae/0x27274ba5bb95353f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265433.145614:0:16540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10037b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a1015321-b6f2-4e27-98e4-70a40da05f32+13:2349:x1876180397585024:12345-192.168.203.37@tcp:4:dd.0 Request processed in 200713us (208004us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1789265433.145624:0:16540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 1 00000100:00100000:1.0:1789265433.145655:0:16540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 5 00000100:00100000:1.0:1789265433.145667:0:16540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bb06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a1015321-b6f2-4e27-98e4-70a40da05f32+12:2349:x1876180397585664:12345-192.168.203.37@tcp:4:dd.0 00010000:00010000:1.0:1789265433.145701:0:16540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000035398f0/0x27274ba5bb953554 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265433.145713:0:16540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265433.145717:0:16540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265433.145723:0:16540:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000035398f0/0x27274ba5bb953554 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265433.145734:0:16540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000035398f0/0x27274ba5bb953554 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265433.152538:0:16541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083f016a2/0x27274ba5bb95355b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265433.152575:0:16541:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265433.153358:0:16541:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265433.153374:0:16541:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083f016a2/0x27274ba5bb95355b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265433.153397:0:16541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083f016a2/0x27274ba5bb95355b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789265433.243234:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00002000:00010000:1.0:1789265433.244343:0:14993:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 4194304 -> 7340032 00002000:00010000:1.0:1789265433.244352:0:14993:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:1.0:1789265433.244376:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004241582/0x27274ba5bb95354d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265433.244391:0:14993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004241582/0x27274ba5bb95354d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265433.244427:0:14993:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004241582/0x27274ba5bb95354d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265433.244435:0:14993:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fa34800 already unused, calling callback (ffffffffc1581350) 00010000:00010000:1.0:1789265433.244441:0:14993:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004241582/0x27274ba5bb95354d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265433.244450:0:14993:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004241582/0x27274ba5bb95354d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265433.244479:0:14993:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004241582/0x27274ba5bb95354d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265433.244500:0:14993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004241582/0x27274ba5bb95354d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265433.244751:0:14993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102efe0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a1015321-b6f2-4e27-98e4-70a40da05f32+15:2348:x1876180397585152:12345-192.168.203.37@tcp:4:dd.0 Request processed in 172294us (300878us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1789265433.244762:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 3 00000100:00100000:1.0:1789265433.244810:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 6 00000100:00100000:1.0:1789265433.244824:0:14993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bb07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a1015321-b6f2-4e27-98e4-70a40da05f32+14:2349:x1876180397585536:12345-192.168.203.37@tcp:4:dd.0 00010000:00010000:1.0:1789265433.244867:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b967bae/0x27274ba5bb953562 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265433.244884:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789265433.244896:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265433.244905:0:14993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b967bae/0x27274ba5bb953562 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265433.244919:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b967bae/0x27274ba5bb953562 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789265433.288794:0:16541:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 12295 00010000:00010000:3.0:1789265433.288824:0:16541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083f016a2/0x27274ba5bb95355b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265433.288840:0:16541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000083f016a2/0x27274ba5bb95355b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265433.288850:0:16541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000083f016a2/0x27274ba5bb95355b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265433.288858:0:16541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a103fa35800 already unused, calling callback (ffffffffc1581350) 00010000:00010000:3.0:1789265433.288863:0:16541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000083f016a2/0x27274ba5bb95355b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265433.288874:0:16541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000083f016a2/0x27274ba5bb95355b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265433.288902:0:16541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000083f016a2/0x27274ba5bb95355b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265433.288910:0:16541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083f016a2/0x27274ba5bb95355b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265433.289023:0:16541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102efe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a1015321-b6f2-4e27-98e4-70a40da05f32+16:2348:x1876180397585408:12345-192.168.203.37@tcp:4:dd.0 Request processed in 143668us (345104us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1789265433.289050:0:16541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 4 00000100:00100000:3.0:1789265433.289137:0:16541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 7 00000100:00100000:3.0:1789265433.289151:0:16541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103bb04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a1015321-b6f2-4e27-98e4-70a40da05f32+15:2349:x1876180397585792:12345-192.168.203.37@tcp:4:dd.0 00010000:00010000:3.0:1789265433.289190:0:16541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049e9e3d4/0x27274ba5bb953569 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265433.289206:0:16541:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265433.289210:0:16541:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265433.289227:0:16541:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049e9e3d4/0x27274ba5bb953569 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265433.289241:0:16541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049e9e3d4/0x27274ba5bb953569 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265433.294388:0:16540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000035398f0/0x27274ba5bb953554 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265433.294415:0:16540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000035398f0/0x27274ba5bb953554 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265433.294425:0:16540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000035398f0/0x27274ba5bb953554 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265433.294434:0:16540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b596400 already unused, calling callback (ffffffffc1581350) 00010000:00010000:2.0:1789265433.294439:0:16540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000035398f0/0x27274ba5bb953554 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265433.294449:0:16540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000035398f0/0x27274ba5bb953554 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265433.294479:0:16540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000035398f0/0x27274ba5bb953554 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265433.294503:0:16540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000035398f0/0x27274ba5bb953554 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265433.294613:0:16540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bb06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a1015321-b6f2-4e27-98e4-70a40da05f32+15:2349:x1876180397585664:12345-192.168.203.37@tcp:4:dd.0 Request processed in 148943us (348170us total) trans 8589934602 rc 0/0 00000100:00100000:2.0:1789265433.294624:0:16540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 5 00000001:00080000:2.0:1789265433.294754:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934603 is committed 00000001:00080000:2.0:1789265433.352342:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00002000:00010000:0.0:1789265433.354100:0:14993:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:0.0:1789265433.354112:0:14993:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:0.0:1789265433.354131:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b967bae/0x27274ba5bb953562 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265433.354148:0:14993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002b967bae/0x27274ba5bb953562 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265433.354157:0:14993:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002b967bae/0x27274ba5bb953562 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265433.354166:0:14993:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a101b597a00 already unused, calling callback (ffffffffc1581350) 00010000:00010000:0.0:1789265433.354171:0:14993:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002b967bae/0x27274ba5bb953562 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265433.354181:0:14993:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002b967bae/0x27274ba5bb953562 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265433.354208:0:14993:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002b967bae/0x27274ba5bb953562 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265433.354228:0:14993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b967bae/0x27274ba5bb953562 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265433.354370:0:14993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bb07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a1015321-b6f2-4e27-98e4-70a40da05f32+9:2349:x1876180397585536:12345-192.168.203.37@tcp:4:dd.0 Request processed in 109544us (407887us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1789265433.354402:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 6 00000100:00100000:1.0:1789265433.394381:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102efe3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414340992:0@lo:400:kworker.0 00000100:00100000:1.0:1789265433.394475:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265433.394550:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102efe2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1876180414341504:0@lo:400:kworker.0 00000100:00100000:1.0:1789265433.394582:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265433.394612:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789265433.394618:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102efe2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414341120:0@lo:400:kworker.0 00000100:00100000:1.0:1789265433.394640:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265433.394757:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102efe3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:3316:1876180414340864:0@lo:400:kworker.0 00000100:00100000:2.0:1789265433.394798:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265433.394826:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102efe1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1876180414341376:0@lo:400:kworker.0 00000100:00100000:2.0:1789265433.394850:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265433.394869:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789265433.394875:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102efe1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876180414341248:0@lo:400:kworker.0 00000100:00100000:2.0:1789265433.394896:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265433.394927:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414341504 00000100:00100000:2.0:1789265433.394936:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414341504 00000100:00100000:2.0:1789265433.394995:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414341376 00000100:00100000:2.0:1789265433.394998:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414341376 00000100:00100000:2.0:1789265433.395011:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414341248 00000100:00100000:2.0:1789265433.395013:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414341248 00000100:00100000:2.0:1789265433.395028:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789265433.395037:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102efe1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1876180414341504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265433.395117:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102efe1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1876180414341504:12345-0@lo:400:kworker.0 Request processed in 80us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265433.395145:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789265433.395166:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789265433.395172:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10037b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1876180414341376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265433.395204:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10037b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1876180414341376:12345-0@lo:400:kworker.0 Request processed in 33us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265433.395209:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789265433.395232:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789265433.395238:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10037b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876180414341248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265433.395262:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10037b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876180414341248:12345-0@lo:400:kworker.0 Request processed in 25us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265433.395268:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789265433.395309:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102efe1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876180414341248:0@lo:400:kworker.0 00000100:00100000:2.0:1789265433.395321:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102efe1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1876180414341376:0@lo:400:kworker.0 00000100:00100000:1.0:1789265433.395437:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102efe2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1876180414341504:0@lo:400:kworker.0 00000100:00100000:1.0:1789265433.395464:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414340992 00000100:00100000:1.0:1789265433.395468:0:14987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414340992 00000100:00100000:1.0:1789265433.395497:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414341120 00000100:00100000:1.0:1789265433.395500:0:14987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414341120 00000100:00100000:1.0:1789265433.395513:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789265433.395520:0:14987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102efe1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1876180414340992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265433.395558:0:14987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102efe1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1876180414340992:12345-0@lo:400:kworker.0 Request processed in 38us (1083us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265433.395564:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789265433.395576:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789265433.395581:0:14987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a102efe3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1876180414341120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265433.395619:0:14987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a102efe3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1876180414341120:12345-0@lo:400:kworker.0 Request processed in 38us (977us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265433.395625:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789265433.395646:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414340864 00000100:00100000:1.0:1789265433.395719:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414340864 00000100:00100000:1.0:1789265433.395750:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789265433.395757:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103cabc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+19:3316:x1876180414340864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265433.395794:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103cabc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d1176c1-422e-4242-ae69-e8c37ea2d5cc+19:3316:x1876180414340864:12345-0@lo:400:kworker.0 Request processed in 38us (995us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265433.395800:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:1.0:1789265433.395826:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789265433.395832:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265433.395855:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102efe3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d1176c1-422e-4242-ae69-e8c37ea2d5cc:3316:1876180414340864:0@lo:400:kworker.0 00000100:00100000:1.0:1789265433.395878:0:3317:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:1.0:1789265433.395884:0:3317:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a0f02da3b80, transno 8589934595 00000004:00080000:1.0:1789265433.395894:0:3317:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:1.0:1789265433.395917:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102efe2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414341120:0@lo:400:kworker.0 00000100:00100000:1.0:1789265433.395929:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102efe3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414340992:0@lo:400:kworker.0 00000100:00100000:0.0:1789265433.405617:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789265433.405662:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102efe3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414341632:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789265433.405758:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265433.405825:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414341632 00000100:00100000:0.0:1789265433.405835:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414341632 00000100:00100000:0.0:1789265433.405897:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789265433.405908:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c079500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876180414341632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789265433.405938:0:14992:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 73203712 pending 1703936 free 3859808256 avail 3850371072 00000100:00100000:0.0:1789265433.405989:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c079500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876180414341632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265433.405997:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789265433.406059:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102efe3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1876180414341632:0@lo:13:osp-pre-1-0.0 00002000:00010000:0.0:1789265433.432245:0:16541:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:0.0:1789265433.432276:0:16541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049e9e3d4/0x27274ba5bb953569 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265433.432293:0:16541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000049e9e3d4/0x27274ba5bb953569 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265433.432303:0:16541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000049e9e3d4/0x27274ba5bb953569 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265433.432311:0:16541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a0f03143200 already unused, calling callback (ffffffffc1581350) 00010000:00010000:0.0:1789265433.432317:0:16541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000049e9e3d4/0x27274ba5bb953569 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265433.432342:0:16541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000049e9e3d4/0x27274ba5bb953569 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265433.432367:0:16541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000049e9e3d4/0x27274ba5bb953569 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265433.432376:0:16541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049e9e3d4/0x27274ba5bb953569 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265433.432557:0:16541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103bb04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a1015321-b6f2-4e27-98e4-70a40da05f32+7:2349:x1876180397585792:12345-192.168.203.37@tcp:4:dd.0 Request processed in 143404us (486032us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1789265433.432569:0:16541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 7 00000001:00080000:2.0:1789265433.433207:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00010000:00010000:2.0:1789265434.034813:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789265434.944847:0:16580:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:3.0:1789265435.058283:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265435.443154:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789265435.443341:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8a102efe2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414341760:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789265435.443407:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265435.443596:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180414341760 00000100:00100000:0.0:1789265435.443605:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180414341760 00000100:00100000:0.0:1789265435.443705:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789265435.443715:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a10037b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414341760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789265435.443747:0:14992:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789265435.443804:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a10037b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876180414341760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265435.443812:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789265435.443854:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8a102efe2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1876180414341760:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789265435.444266:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789265436.082436:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265436.404427:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265436.404482:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265436.404519:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265436.404544:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265436.404562:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265436.404605:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789265436.404832:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397586176 00000100:00100000:3.0:1789265436.404845:0:14987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397586176 00000100:00100000:3.0:1789265436.404908:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397586688 00000100:00100000:3.0:1789265436.404911:0:14987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397586688 00000100:00100000:3.0:1789265436.404927:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397586304 00000100:00100000:3.0:1789265436.404929:0:14987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397586304 00000100:00100000:3.0:1789265436.404948:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 20 00000100:00100000:3.0:1789265436.404960:0:14987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c079180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1015321-b6f2-4e27-98e4-70a40da05f32+5:2349:x1876180397586176:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789265436.405066:0:14987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c079180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1015321-b6f2-4e27-98e4-70a40da05f32+5:2349:x1876180397586176:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 108us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265436.405106:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 20 00000100:00100000:3.0:1789265436.405124:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 21 00000100:00100000:3.0:1789265436.405130:0:14987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c079f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0402ccd4-bc8e-4a9b-ad20-843e6e477335+5:2349:x1876180397586688:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789265436.405151:0:14987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c079f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0402ccd4-bc8e-4a9b-ad20-843e6e477335+5:2349:x1876180397586688:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 22us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265436.405156:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 21 00000100:00100000:3.0:1789265436.405164:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 22 00000100:00100000:3.0:1789265436.405170:0:14987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c078000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1015321-b6f2-4e27-98e4-70a40da05f32+5:2349:x1876180397586304:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789265436.405192:0:14987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c078000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1015321-b6f2-4e27-98e4-70a40da05f32+5:2349:x1876180397586304:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 22us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265436.405208:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 22 00000100:00080000:3.0:1789265436.405228:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789265436.405232:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265436.405323:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789265436.405347:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397586432 00000100:00100000:0.0:1789265436.405352:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397586432 00000100:00100000:0.0:1789265436.405385:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397586048 00000100:00100000:0.0:1789265436.405388:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397586048 00000100:00100000:0.0:1789265436.405409:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 29 00000100:00100000:0.0:1789265436.405417:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c07b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0402ccd4-bc8e-4a9b-ad20-843e6e477335+6:2349:x1876180397586432:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789265436.405456:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c07b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0402ccd4-bc8e-4a9b-ad20-843e6e477335+6:2349:x1876180397586432:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 41us (937us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265436.405474:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 29 00000100:00100000:0.0:1789265436.405488:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 30 00000100:00100000:0.0:1789265436.405494:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c07aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1015321-b6f2-4e27-98e4-70a40da05f32+20:2349:x1876180397586048:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789265436.405520:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c07aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1015321-b6f2-4e27-98e4-70a40da05f32+20:2349:x1876180397586048:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 27us (957us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265436.405527:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 30 00000100:00100000:0.0:1789265436.405545:0:14989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397586560 00000100:00100000:0.0:1789265436.405549:0:14989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397586560 00000100:00100000:0.0:1789265436.405566:0:14989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 23 00000100:00100000:0.0:1789265436.405571:0:14989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103c07bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0402ccd4-bc8e-4a9b-ad20-843e6e477335+5:2349:x1876180397586560:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789265436.405595:0:14989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103c07bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0402ccd4-bc8e-4a9b-ad20-843e6e477335+5:2349:x1876180397586560:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 24us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265436.405603:0:14989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 23 00000100:00100000:1.0:1789265436.405846:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180397585920 00000100:00100000:1.0:1789265436.405852:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180397585920 00000100:00100000:1.0:1789265436.405886:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 123 00000100:00100000:1.0:1789265436.405894:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a103cabdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+13:2349:x1876180397585920:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789265436.405923:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a103cabdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a430b7c-fa3a-4f96-b1b6-57fba480f0e0+13:2349:x1876180397585920:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 31us (1513us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265436.405943:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 123 00000100:00080000:3.0:1789265436.407861:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789265436.407873:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 Debug log: 29293 lines, 29293 kept, 0 dropped, 0 bad.